Sponsored Content
Top Forums UNIX for Dummies Questions & Answers deleting 100k log files quickly Post 27288 by oombera on Thursday 29th of August 2002 01:29:16 PM
Old 08-29-2002
Okay, now that I've read your post and thought about it, that makes complete sense. Usually, you don't even think about the overhead in reading a directory, finding the correct file, etc. when removing files.

Then again, I have wondered why deleting one 100MB file in Windows is alot faster than deleting a hundred files that are each much smaller than a meg... same principle I'm sure.
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

deleting log files only in particular directories

Hi My problem is i have to remove some log files in specific named directories on a regular basis using shell scripts. What i want my shell script to do is i give the shell script some listing of directories from which to delete all log files recursively. Can anyone please help me. ... (2 Replies)
Discussion started by: sameervs
2 Replies

2. Shell Programming and Scripting

command for deleting log files based on some condition

Hello, Can anyone pls. provide me with the command for deleting files older then 15 days with a restriction to keep at least 5 files in a directory even if they are older then 15 days. Any help will be highly appreciated. Thanks, Pulkit (4 Replies)
Discussion started by: pulkit
4 Replies

3. UNIX for Dummies Questions & Answers

need solution for this quickly. please quickly.

Write a nawk script that will produce the following report: ***FIRST QUARTERLY REPORT*** ***CAMPAIGN 2004 CONTRIBUTIONS*** ------------------------------------------------------------------------- NAME PHONE Jan | ... (5 Replies)
Discussion started by: p.palakj.shah
5 Replies

4. Shell Programming and Scripting

Kron Shell: deleting all but most recent log files

I am trying to create a Korn Shell script to be run every 5-10 minute from a crontab. This script needs to look for log files (transaction_<date>.log). If there are more than 5 such files, it needs to delete all but the most current 5. How often these files are create varies - can be every minute... (2 Replies)
Discussion started by: WmShaw
2 Replies

5. Shell Programming and Scripting

Moving 100K file to another folder using 1 command

Hi, I need to move 1000s of files from one folder to another. Actually there are 100K+ files. Source dir : source1 Target dir : target1 Now if try cp or mv commands I am getting an error message : Argument List too long. I tried to do it by the time the files are created in the source... (6 Replies)
Discussion started by: unx100
6 Replies

6. Shell Programming and Scripting

Need to delete large set of files (i.e) close to 100K from a directory based on the input file

Hi all, I need a script to delete a large set of files from a directory under / based on an input file and want to redirect errors into separate file. I have already prepared a list of files in the input file. Kndly help me. Thanks, Prash (36 Replies)
Discussion started by: prash358
36 Replies

7. Shell Programming and Scripting

Getting folder more than 100K size

Hi , I am trying to get the folder details having size more than sme specified value and also the name of the folder should be like TEST. so 1. In the current directory search for all the folders having name like TEST 2. Print the list of the folder names having size more than 100... (3 Replies)
Discussion started by: Anupam_Halder
3 Replies

8. Solaris

ZFS does not release space even after deleting application log files in a non-global zone

Hi Guys, I have a non-global zone in which has apache application on it. There is a ZFS filesystem where the app saves the log. Even after deleting the logfiles I dont see the space being freed up. There are no snapshots or anything at all Zpool info NAME SIZE ALLOC FREE CAP HEALTH ALTROOT... (8 Replies)
Discussion started by: RDX
8 Replies

9. Shell Programming and Scripting

Deleting dated log files whihc are older than an year

Hi. There is a process which creates log files in the below naming format processname.20140425.log processname1.20140425.log And in this path along with these logs there are other files which have the timestamp from 2012 and i want to have a script in place to delete only the above log files... (13 Replies)
Discussion started by: nanz143
13 Replies
FASTRM(8)						      System Manager's Manual							 FASTRM(8)

NAME
fastrm - quickly remove a set of files SYNOPSIS
fastrm [ -d ] [ -e ] [ -uN ] [ -sM ] [ -cI ] base_directory DESCRIPTION
Fastrm reads a list of files, one per line, from its standard input and removes them. If a file is not an absolute pathname, it is taken relative to the directory specified on the command line. The base_directory parameter must be a simple absolute pathname -- that is, it must not contain any ``/./'' or ``/../'' references. Fastrm is designed to be faster than the typical ``| xargs rm'' pipeline. For example, fastrm will usually chdir(2) into a directory before removing files from it. If the input is sorted, this means that most files to be removed will be simple names. Fastrm assumes that its input is valid and that it is safe to just do an unlink(2) call for each item to be removed. As a safety measure, if fastrm is run by root it will first stat(2) the item to make sure that it is not a directory before unlinking it. OPTIONS
-d If the ``-d'' flag is used then no files are removed. Instead a list of the files to be removed, in debug form, is printed on the standard output. Each line contains either the current directory of fastrm at the time it would do the unlink, and then the path name it would pass to unlink(2) as two fields separated by white space and a ``/'', or the absolute path name (a single field) of files it would unlink using the absolute path name. -e If the ``-e'' flag is used, fastrm will treat an empty input file (stdin) as an error. This is most useful when fastrm is last in a pipeline after a preceding sort(1) as if the sort fails, there will usually be no output to become input of fastrm. -u If the ``-u'' flag is used, then fastrm makes further assumptions about its work environment; in particular, that there are no sym- bolic links in the target tree. This flag also suggests that it is probably faster to reference the path ``../../../'' rather than start from the root and come down. (Note that this probably isn't true on systems that have a namei cache, which usually holds everything except ``..''). The optional N is an integer that specifies the maximum number of ``..'' segments to use -- paths that would use more than this use the absolute path name (from the root) instead. If the ``-u'' flag is given without a value, ``-u1'' is assumed. -s If the ``-s'' flag is used, then fastrm will perform the unlinks from one directory -- that is when a group of files in one direc- tory appear in the input consecutively -- in the order that the files appear in the directory from which they are to be removed. The intent of this flag is that on systems that have a per-process directory cache, finding files in the directory should be faster. It can have smaller benefits on other systems. The optional M is an integer that specifies the number of files that must be going to be removed from one directory before the files will be ordered. If the ``-s'' flag is given without a value, ``-s5'' is assumed. When the directory reordering is in use fastrm will avoid attempting to unlink files that it can't see in the directory, which can speed it appreciably when many of the file names have already been removed. -c The ``-c'' flag may be given to instruct fastrm when it should chdir(2). If the number of files to be unlinked from a directory is at least I then fastrm will chdir and unlink the files from in the directory. Otherwise it will build a path relative to its cur- rent directory. If ``-c'' is given without the optional integer I then ``-c1'' is assumed, which will cause fastrm to always use chdir. If ``-c'' is not used at all, then ``-c3'' is assumed. Use ``-c0'' to prevent fastrm from ever using chdir(2). -a -r There are also ``-a'' and ``-r'' options, which do nothing at all, except allow you to say ``fastrm -usa'' ``fastrm -ussr'' or ``fastrm -user''. These happen to often be convenient sets of options to use. EXIT STATUS
Fastrm exits with a status of zero if there were no problems, or one if something went wrong. Attempting to remove a file that does not exist is not considered a problem. If the program exits with a non-zero status, it is probably a good idea to feed the list of files into an ``xargs rm'' pipeline. HISTORY
This is revision 1.3, dated 1996/10/29. FASTRM(8)
All times are GMT -4. The time now is 12:59 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy