How to delete a huge number of files at a time Post: 302484129

10 More Discussions You Might Find Interesting

1. Filesystems, Disks and Memory

Time taken for creation of a huge core file

Hi, I needed to know how I can find out the time needed for an Unix machine(HP) to create a corefile as huge as 500MB(core created either by a SEGV or a kill -6 command). An approximate figure of the time taken would be really helpful.:confused:

2. Shell Programming and Scripting

Delete lines from huge file

I have to delete 1st 7000 lines of a file which is 12GB large. As it is so large, i can't open in vi and delete these lines. Also I found one post here which gave solution using perl, but I don't have perl installed. Also some solutions were redirecting the o/p to a different file and renaming it....

3. UNIX for Dummies Questions & Answers

Need to delete the files based on the time stamp of the file

Hi Everyone, I want to delete some files in a path based on the time stamp of the file that is i want to delete the file once in a month. Can any one help me on this? Thanks in advance

4. UNIX for Dummies Questions & Answers

Delete large number of files

Hi. I need to delete a large number of files listed in a txt file. There are over 90000 files in the list. Some of the directory names and some of the file names do have spaces in them. In the file, each line is a full path to a file: /path/to/the files/file1 /path/to/some other/files/file 2...

5. Shell Programming and Scripting

search a number in very very huge amount of data

Hi, I have to search a number in a very long listing of files.the total size of the files in which I have to search is 10 Tera Bytes. How to search a number in such a huge amount of data effectively.I used fgrep but it is taking many hours to search. Is there any other feasible solution to...

6. Shell Programming and Scripting

Shell Script to delete files within a particular time frame under multiple sub folders

Greetings! I'm looking for starting information for a shell script. Here's my scenario: I have multiple folders(100) for example: /www/test/applications/app1/logs /www/test/applications/app2/logs Within these folders there are log files files that need to be deleted after a month. ...

7. Shell Programming and Scripting

Search and replace ---A huge number of files

Hello Friends, I have the below scenario in my current project. Suggest me which tool ( perl,python etc) is best to this scenario. Or should I go for Programming language ( C/Java ).. (1) I will be having a very big file ( information about 200million subscribers will be stored in it ). This...

8. Shell Programming and Scripting

Split a folder with huge number of files in n folders

We have a folder XYZ with large number of files (>350,000). how can i split the folder and create say 10 of them XYZ1 to XYZ10 with 35,000 files each. (doesnt matter which files go where).

9. UNIX for Beginners Questions & Answers

Count the number of files to delete doesnt match

Good evening, need your help please Need to delete certain files before octobre 1 2016, so need to know how many files im going to delete, for instance ls -lrt file_20160*.lis!wc -l but using grep -c to another file called bplist which contains the list of all files backed up doesn match...

10. Shell Programming and Scripting

Help for Count number of files in certain time

Chaps, I need to count number of files in a remote directory from Linux (FreeBSD) as if 10 trace files (log files) been generated within 5min of time. So this is the script then I can setup a monitoring. I came across with ls -1 \ip\d:\Logs | wc -l but then what else requires to check time...

LEARN ABOUT DEBIAN

dbswiss

DBSWISS(1)							   User Commands							DBSWISS(1)

NAME

       dbSwiss - create DBM version of Swiss-Prot data

SYNOPSIS

       /usr/share/librg-utils-perl/dbSwiss [OPTIONS]

       /usr/share/librg-utils-perl/dbSwiss --datadir /data/swissprot --infile /data/swissprot/uniprot_sprot.dat

       /usr/share/librg-utils-perl/dbSwiss [--help] [--man]

DESCRIPTION

       dbSwiss creates DBM version of Swiss-Prot data.	This procedure is to replace splitSwiss.pl.  splitSwiss.pl saves Swiss-Prot records in
       separate files resulting in over 13 million relatively tiny files that take very long to create and rsync.  dbSwiss instead saves each
       record into a DBM database that is optimized for fast retrieval.

OPTIONS

       -d, --datadir=path
	   directory of database files, default: '/mnt/project/rost_db/data/swissprot'

       --debug
       --nodebug
       --first20
       --nofirst20
	   process only first 20 records, for debugging

       --help
       -i, --infile=path
	   Swiss-Prot data flatfile, default: '/mnt/project/rost_db/data/swissprot/uniprot_sprot.dat'.

       --man
       --quiet
       --noquiet
	   do not print progress status

       --readback
       --noreadback
	   read records back after storing and print them

       --table
	   name of database table and consequently the base name of database files, default: 'dbswiss'

       --version
       -w, --workdir=path
	   Optional working directory. Automatically created and removed if not defined.

AUTHOR

       Laszlo Kajan <lkajan@rostlab.org>

1.0.43								    2011-11-28								DBSWISS(1)

10 More Discussions You Might Find Interesting

1. Filesystems, Disks and Memory

Time taken for creation of a huge core file

Discussion started by: nayeem

2. Shell Programming and Scripting

Delete lines from huge file

Discussion started by: rahulrathod

3. UNIX for Dummies Questions & Answers

Need to delete the files based on the time stamp of the file

Discussion started by: samudha

4. UNIX for Dummies Questions & Answers

Delete large number of files

Discussion started by: inakajin