Pls. help with script to remove million files Post: 302862411

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Script to mv files and then remove

Hi Guys i'm looking for some help with creating a scripts: Background - I run alot of testing which creates huge files. This fills up the diskspace over 3 weeks so needs constant deleting. but generally, I keep forgetting!!! so every 3 weeks it fails lol. Basically i can't format the drive...

2. Solaris

Need to know command to delete more than 3 million files from /var/spool/clientmqueue

Hi I need to delete more than 3 million files from /var/spool/clientmqueue. When I give the following command to delete the files, I get the error # pwd /var/spool/clientmqueue # rm -f * /usr/bin/rm: arg list too long Please tell me how can I delete the files

3. Shell Programming and Scripting

Matching 10 Million file records with 10 Million in other file

Dear All, I have two files both containing 10 Million records each separated by comma(csv fmt). One file is input.txt other is status.txt. Input.txt-> contains fields with one unique id field (primary key we can say) Status.txt -> contains two fields only:1. unique id and 2. status ...

4. Shell Programming and Scripting

Fast processing(mv command) of 1 million+ files using find, mv and xargs

Hi, I'd like to ask if anybody can help improve my code to move 1 million+ files from a directory to another: find /source/dir -name file* -type f | xargs -I '{}' mv {} /destination/dir I learned this line of code from this forum as well and it works fine. However, file movement is kinda...

5. UNIX for Dummies Questions & Answers

Deleting a million of files ..

Hi, Which way is faster rm -rf /path/ or find / -name -exec rm {} \; and why?

6. UNIX for Dummies Questions & Answers

Pls. help remove the static route

Hi, I am on Linux Redhat 5.3. I added this static route but now I can't seem to take it out. Can you help? netstat -rn Kernel IP routing table Destination Gateway Genmask Flags MSS Window irtt Iface 167.76.151.28 192.1.25.249 255.255.255.255 UGH 0 0...

7. AIX

Script to remove backup files

HI, I want to remove my backup files keeping last 30 days. Now i am doing it manually. Does anyone have a script to automate this process? Thanks in advance

8. Shell Programming and Scripting

How to remove newline, tab, spaces in curly braces.. :( Pls Help?

Hi Everyone, in the below "xyz (Exception e)" part... after the curly braces, there is a new line and immediately few tabs are present before closing curly brace. xyz (Exception e) { } note: there can be one or more newlines between the curly braces. My desired output should be ...

9. UNIX for Advanced & Expert Users

Zip million files taking 12 hours or more

Hi I have task to zip files based on modified time but they are in millions and it is taking lot of time more than 12 hours and also eating up high cpu is there any other / better way to handle it quickly with less cpu consumptionfind . ! -name \"*.gz\" -mtime +7 -type f | grep -v '/.*/' |...

LEARN ABOUT CENTOS

bf_tar

BF_TAR(1)						    Bogofilter Reference Manual 						 BF_TAR(1)

NAME

       bf_tar - shell script to write a tar file of a bogofilter directory to stdout

SYNOPSIS

       bf_tar [-r] [-R] bogofilter_directory

DESCRIPTION

       bf_tar bundles a bogofilter working directory in tar format and copies it to standard output (your console, or where you redirect it, see
       EXAMPLES below).

OPTIONS

       The -r option causes bf_tar to remove inactive log files after the archive has been written successfully. The default is to leave log
       files.

       The -R option causes bf_tar to remove inactive log files before the archive is written. This may reduce chances that the resulting archive
       is recoverable should it become damaged. The archive may be smaller though. The default is to leave log files.

EXIT STATUS

       The script exits with status code 0 if everything went well, and nonzero if it encountered trouble.

EXAMPLES

       o   bf_tar ~/.bogofilter > outfile.tar

	   Writes a standard .tar file containing the essential files from ~/.bogofilter to outfile.tar.

       o   bf_tar ~/.bogofilter | gzip -9 -c > outfile.tar.gz

	   Writes a gzipped .tar.gz file containing the essential files from ~/.bogofilter to outfile.tar.gz.

       o   bf_tar `pwd`/mydirectory > outfile.tar

	   Prepend $(pwd)/ or `pwd`/ if you want to specify an absolute path instead of a relative path.

NOTES

       This script is meant for use with Berkeley DB based bogofilter versions.

       This script requires a SUSv2 compliant pax utility.

       This script expects a SUSv2 compliant shell. Solaris systems should have the SUNWxcu4 package installed (when bogofilter is configured) so
       that /usr/xpg4/bin/sh can be used.

AUTHORS

       Matthias Andree

Bogofilter							    10/22/2012								 BF_TAR(1)