Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Fine Tune - Huge files/directory - Purging

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Fine Tune - Huge files/directory - Purging
# 15  
Old 06-16-2011
To all,

The script throws some error because its unable to delete the file with spaces, so i refered the site and found one solution for that

Now I am using
Code:
 
xargs -I{} rm {}

Is there any performance degration or skipping of files happens ..?
# 16  
Old 06-21-2011
I usually use
Code:
find $DIR -print0 | xargs -0 command

construct, which uses NULL to separate the arguments, and whitespaces are no longer special. You can look into that, if it's supported on your system. I recommend doing a benchmark yourself, since it may vary from system to system, but I wouldn't expect to see huge differences in performance.
This User Gave Thanks to mirni For This Post:
senthil.ak
# 17  
Old 06-22-2011
print0 is not working in my system
Code:
 find: 0652-017 -print0 is not a valid option.

Thanks
# 18  
Old 06-22-2011
You only get -print0 with GNU find/xargs.

The -I{} solution ought to work with the same performance unless you have a newline in a filename. If you do, only print0 can handle that without a hitch.
# 19  
Old 07-04-2011
Hi admin,
When i Used the above xargs command I'm getting below error "xargs -I{} rm {}"
Code:
xargs: Missing quote:

When I checked this the file name contains double quote and some contains single quote. How to overcome this. Do i will go back to -exec rm command again with + symbol?
Thanks
sample file names
Code:
 
./DÉPENSES PAR INDUS.    THALES GROUP "EURO"-THALES (CYCLIQUE).HTML
./PRINCIPAUX FOURNI'S.    THALES (CYCLIQUE).HTML

# 20  
Old 07-05-2011
Code:
 ... | xargs -d '\n' rm

should work as long as your filenames don't contain newlines!
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Need help with listing file name and modified date on a huge directory

hi, We have a huge directory that ha 5.1 Million files in it. We are trying to get the file name and modified timestamp of the most recent 3 years from this huge directory for a migration project. However, the ls command (background process) to list the file names and timestamp is running for... (2 Replies)
Discussion started by: subbu
2 Replies

2. Shell Programming and Scripting

Disc space issues and purging of files

Hi All, I am looking forward to create a unix shell script to purge the files. The requirement is: 1) Do df -k and check the current space occupied for the /a1 folder. 2) If the space consumed is greater than 90 %, delete all the DEF* files from a subfolder /a1/archive. Example: df... (4 Replies)
Discussion started by: shilpa_acc
4 Replies

3. Shell Programming and Scripting

Fine tune this perl script to add router

Hi, I have this routine that reads a microsoft dhcp.netsh dump. Where it finds optionvalue 3 STRING "0.0.0.0" Replace it with the router IP based on the network !/usr/bin/perl while ( <> ) { if ( /\# NET / ) { $net = $'; $net =~ s///g; } else { s/set optionvalue 3... (1 Reply)
Discussion started by: richsark
1 Replies

4. Programming

SQL : Fine tune Insert by query

i would like to know how can i fine tune the following query since the cost of the query is too high .. insert into temp temp_1 select a,b,c,d from xxxx .. database used is IDS.. (1 Reply)
Discussion started by: expert
1 Replies

5. Shell Programming and Scripting

purging of Files

Hello All, I want to delete the files based on the days. like, Files available under directory /abc want to delete if they are older than 15 days. Files available under directory /pqr want to delete if they are 7 days old and some files under directory /xyz should get deleted if they are... (5 Replies)
Discussion started by: ssachins
5 Replies

6. Shell Programming and Scripting

Shell script for purging the 3 days old files

Hi all, I try to write shell script to the below requirement. I have Hard coded the oratab location and take the list of databases from oratab and find out archive log locations for each database, and list more than 3 days old files for each location and purge those. ... (2 Replies)
Discussion started by: mak_boop
2 Replies

7. Cybersecurity

How to fine Tune and Harden the Linux kernel

Hi, As a a security audit, how can I proceed further with Fine tuning and Hardening the linux kernel... I am not sure with the steps how to proceed further... If i do some thing wrong, then its comes with the Kernel panic error. So, I am afraid, how to do the tuning with the kernel.. (1 Reply)
Discussion started by: gsiva
1 Replies

8. Shell Programming and Scripting

Best way to diff two huge directory trees

Hi I have a job that will be running nightly incremental backsup of a large directory tree. I did the initial backup, now I want to write a script to verify that all the files were transferred correctly. I did something like this which works in principle on small trees: diff -r -q... (6 Replies)
Discussion started by: same1290
6 Replies

9. Shell Programming and Scripting

Error While Purging Files

find /filearchive/ -type f -mtime +7 -exec rm weblogs*.log {} \; This worked only if this comand is executed int he unix comand prompt, but when i put this in the shell script it is not recognizing the file.It says weblogs: No such file or directory Am i doing anything wrong here ? (4 Replies)
Discussion started by: svishh123
4 Replies

10. Shell Programming and Scripting

Purging a Set of Files

Hi Frineds, I want to delete a set of files which are older than 7 days from teh current date.I am totally enw to shell scripting, can anyone help me with a sample code to list out the files which are older and then remove them from the directory. Please help THanks Viswa (5 Replies)
Discussion started by: svishh123
5 Replies
Login or Register to Ask a Question