Deleting a million of files .. Post: 302897602

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need help comparing two files and deleting some things in those files!

So I have two files: File1 pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2 pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2 ref4948 1.1 treehouse.txt 1.6 ref8573 1.5 ref3284 1.4 ref5838...

2. Solaris

Need to know command to delete more than 3 million files from /var/spool/clientmqueue

Hi I need to delete more than 3 million files from /var/spool/clientmqueue. When I give the following command to delete the files, I get the error # pwd /var/spool/clientmqueue # rm -f * /usr/bin/rm: arg list too long Please tell me how can I delete the files

3. Shell Programming and Scripting

AIX system.... deleting files in remote directory after retrieving files

Hi Friends, I am new to this , I am working on AIX system and my scenario is to retrive the files from remote system and remove the files from the remote system after retreving files. I can able to retrieve the files but Can't remove files in remote system. Please check my code and help me out...

4. Shell Programming and Scripting

Deleting files

Hi all, I have developed a shell script to copy the files from source to destination and simultaneously to delete the copied files in source. I can copy the files but the files cannot be deleted in source side.

5. Shell Programming and Scripting

Matching 10 Million file records with 10 Million in other file

Dear All, I have two files both containing 10 Million records each separated by comma(csv fmt). One file is input.txt other is status.txt. Input.txt-> contains fields with one unique id field (primary key we can say) Status.txt -> contains two fields only:1. unique id and 2. status ...

6. Shell Programming and Scripting

Fast processing(mv command) of 1 million+ files using find, mv and xargs

Hi, I'd like to ask if anybody can help improve my code to move 1 million+ files from a directory to another: find /source/dir -name file* -type f | xargs -I '{}' mv {} /destination/dir I learned this line of code from this forum as well and it works fine. However, file movement is kinda...

7. UNIX for Dummies Questions & Answers

Pls. help with script to remove million files

Hi, one of the server, log directory was never cleaned up. We have so many files. I want to remove all the files that starts with dfr* but I get error message when I use the *. rm qfr* bash: /usr/bin/rm: Arg list too long I am trying to write this script but not working. ...

8. Shell Programming and Scripting

Bash script deleting my files, and editing files in subdirectories question

#!/bin/bash # name=$1 type=$2 number=1 for file in ./** do if then filenumber=00$number elif then filenumber=0$number fi tempname="$name""$filenumber"."$type" if

9. UNIX for Advanced & Expert Users

Zip million files taking 12 hours or more

Hi I have task to zip files based on modified time but they are in millions and it is taking lot of time more than 12 hours and also eating up high cpu is there any other / better way to handle it quickly with less cpu consumptionfind . ! -name \"*.gz\" -mtime +7 -type f | grep -v '/.*/' |...

LEARN ABOUT OSX

shar

SHAR(1) 						    BSD General Commands Manual 						   SHAR(1)

NAME

     shar -- create a shell archive of files

SYNOPSIS

     shar file ...

DESCRIPTION

     shar writes an sh(1) shell script to the standard output which will recreate the file hierarchy specified by the command line operands.
     Directories will be recreated and must be specified before the files they contain (the find(1) utility does this correctly).

     shar is normally used for distributing files by ftp(1) or mail(1).

SEE ALSO

     compress(1), mail(1), tar(1), uuencode(1)

BUGS

     shar makes no provisions for special types of files or files containing magic characters.

EXAMPLES

     To create a shell archive of the program ls(1) and mail it to Rick:

	   cd ls
	   shar `find . -print` |  mail -s "ls source" rick

     To recreate the program directory:

	   mkdir ls
	   cd ls
	   ...
	   <delete header lines and examine mailed archive>
	   ...
	   sh archive

HISTORY

     The shar command appears in 4.4BSD.

SECURITY CONSIDERATIONS

     It is easy to insert trojan horses into shar files.  It is strongly recommended that all shell archive files be examined before running them
     through sh(1).  Archives produced using this implementation of shar may be easily examined with the command:

	   egrep -v '^[X#]' shar.file

4.4BSD								   June 6, 1993 							    4.4BSD