Fast processing(mv command) of 1 million+ files using find, mv and xargs Post: 302789291

9 More Discussions You Might Find Interesting

1. AIX

command usage on find with xargs and tar

my task : tar up large bunch of files(about 10,000 files) in the current directories that created more than 30 days ago but it come with following error find ./ -ctime +30 | xargs tar rvf test1.tar tar: test1.tar: A file or directory in the path name does not exist.

2. UNIX for Dummies Questions & Answers

use of xargs and prune piping with find command.

Can anyone interpret and tell me the way the below command works? find * -name "*${msgType}" -mtime +${archiveDays} -prune -type f -print 2>/dev/null | xargs rm -f 2> /dev/null Please tell me the usage of prune and xargs in the above command? Looking forward your reply. Thanks in...

3. Shell Programming and Scripting

find with xargs to rm found files

I believe what is happening is rm is executing in the script on every directory and on failure of the first it stops although returns status 0. find $HOME -name /directory/filename | xargs -l rm This is the code I use but file remains. I am using sun solaris system which has way limited...

4. Solaris

Need to know command to delete more than 3 million files from /var/spool/clientmqueue

Hi I need to delete more than 3 million files from /var/spool/clientmqueue. When I give the following command to delete the files, I get the error # pwd /var/spool/clientmqueue # rm -f * /usr/bin/rm: arg list too long Please tell me how can I delete the files

5. Shell Programming and Scripting

help using find/xargs to apply mp3gain to files

I need to apply mp3gain (album mode) to all mp3 files in a given directory. Each album is in its own directory under /media/data/music/albums for example: /media/data/music/albums/foo /media/data/music/albums/bar /media/data/music/albums/more What needs to happen is: cd...

6. Shell Programming and Scripting

find numeric duplicates from 300 million lines....

these are numeric ids.. 222932017099186177 222932014385467392 222932017371820032 222932017409556480 I have text file having 300 millions of line as shown above. I want to find duplicates from this file. Please suggest the quicker way.. sort | uniq -d will...

7. UNIX for Dummies Questions & Answers

Deleting a million of files ..

Hi, Which way is faster rm -rf /path/ or find / -name -exec rm {} \; and why?

8. Shell Programming and Scripting

Parallel processing for functions in xargs

I have a script (ksh) which tries to run a function in parallel for performance gains. I am also trying to limit the number of parallel child processes to avoid overloading the system by using a variable to count triggered processes and waiting for completion e.g. do_something () { ... } ...

9. UNIX for Advanced & Expert Users

Zip million files taking 12 hours or more

Hi I have task to zip files based on modified time but they are in millions and it is taking lot of time more than 12 hours and also eating up high cpu is there any other / better way to handle it quickly with less cpu consumptionfind . ! -name \"*.gz\" -mtime +7 -type f | grep -v '/.*/' |...

LEARN ABOUT REDHAT

dumpe2fs

DUMPE2FS(8)						      System Manager's Manual						       DUMPE2FS(8)

NAME

       dumpe2fs - dump filesystem information

SYNOPSIS

       dumpe2fs [ -bfhixV ] [ -ob superblock ] [ -oB blocksize ] device

DESCRIPTION

       dumpe2fs prints the super block and blocks group information for the filesystem present on device.

       dumpe2fs is similar to Berkeley's dumpfs program for the BSD Fast File System.

OPTIONS

       -b     print the blocks which are reserved as bad in the filesystem.

       -ob superblock
	      use  the	block  superblock  when  examining the filesystem.  This option is not usually needed except by a filesystem wizard who is
	      examining the remains of a very badly corupted filesystem.

       -oB blocksize
	      use blocks of blocksize bytes when examining the filesystem.  This option is not usually needed except by a filesystem wizard who is
	      examining the remains of a very badly corupted filesystem.

       -f     force  dumpe2fs to display a filesystem even though it may have some filesystem feature flags which dumpe2fs may not understand (and
	      which can cause some of dumpe2fs's display to be suspect).

       -h     only display the superblock information and not any of the block group descriptor detail information.

       -i     display the filesystem data from an image file created by e2image, using device as the pathname to the image file.

       -x     print the detailed group information block numbers in hexadecimal format

       -V     print the version number of dumpe2fs and exit.

BUGS

       You need to know the physical filesystem structure to understand the output.

AUTHOR

       dumpe2fs was written by Remy Card <Remy.Card@linux.org>.

AVAILABILITY

       dumpe2fs is part of the e2fsprogs package and is available from http://e2fsprogs.sourceforge.net.

SEE ALSO

       e2fsck(8), mke2fs(8), tune2fs(8)

E2fsprogs version 1.32						   November 2002						       DUMPE2FS(8)