faster command than find for sorting?

Login or Register to Ask a Question and Join Our Community

faster command than find for sorting?

Tags

Login to Discuss or Reply to this Discussion in Our Community

Top Forums Shell Programming and Scripting faster command than find for sorting?

02-09-2010

Registered User

116, 2

Join Date: Nov 2008

Last Activity: 18 November 2015, 1:00 PM EST

Posts: 116

Thanks Given: 14

Thanked 2 Times in 2 Posts

faster command than find for sorting?

I'm sorting files from a source directory by size into 4 categories then copying them into 4 corresponding folders, just wondering if there's a faster/better/more_elegant way to do this:

Code:

find /home/user/sourcefiles -type f -size -400000k -exec /bin/cp -uv {} /home/user/medfiles/ \;
find /home/user/medfiles -type f -size -200000k -exec /bin/mv {} /home/user/smallfiles/ \;
find /home/user/sourcefiles -type f -size +400000k -exec /bin/cp -uv {} /home/user/reallybigfiles/ \;
find /home/user/reallybigfiles -type f -size -1000000k -exec /bin/mv {} /home/user/bigfiles/ \;

I have 570G of source files and need to sync updates about every hour, I update the sourcefiles using rsync and then run this to sort them.

unclecameron

View Public Profile for unclecameron

Find all posts by unclecameron

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to make awk command faster?

I have the below command which is referring a large file and it is taking 3 hours to run. Can something be done to make this command faster. awk -F ',' '{OFS=","}{ if ($13 == "9999") print $1,$2,$3,$4,$5,$6,$7,$8,$9,$10,$11,$12 }' ${NLAP_TEMP}/hist1.out|sort -T ${NLAP_TEMP} |uniq>...

2. Shell Programming and Scripting

Recursive folder search faster than find?

I'm trying to find folders created by a propritary data aquisition software with the .aps ending--yes, I have never encountered folder with a suffix before (some files also end in .aps) and sort them by date. I need the whole path ls -dt "$dataDir"*".aps"does exactly what I want except for the...

3. Solaris

Monitoring log file for entries - Find command & sorting

hi, I would like to monitor a log file, which rolls over, everytime a server is restarted. I would like to grep for a string, and to be more efficient i'd like to grep only newly appended data. so something like a 'tail -f' would do, however, as the log rolls over i think a 'tail -F' is...

4. UNIX for Dummies Questions & Answers

A faster equivalent for this sed command

Hello guys, I'm cleaning out big XML files (we're talking about 1GB at least), most of them contain words written in a non-latin alphabet. The command I'm using is so slow it's not even funny: cat $1 | sed -e :a -e 's/<*>//g;/</N;//ba;s/</ /g;s/>/...

5. Shell Programming and Scripting

Faster way to use this awk command

awk "/May 23, 2012 /,0" /var/tmp/datafile the above command pulls out information in the datafile. the information it pulls is from the date specified to the end of the file. now, how can i make this faster if the datafile is huge? even if it wasn't huge, i feel there's a better/faster way to...

6. HP-UX

Faster command for file copy than cp ?

we have 30 GB files on our filesystem which we need to copy daily to 25 location on the same machine (but different filesystem). cp is taking 20 min to do the copy and we have 5 different thread doing the copy. so in all its taking around 2 hr and we need to reduce it. Is there any...

7. Shell Programming and Scripting

HELP need to split this line faster than cut-command

Hi, A datafile containing lines such as below needs to be split: 500000000000932491683600000000000000000000000000016800000GS0000000000932491683600*HOME I need to get the 2-5, 11-20, and 35-40 characters and I can do it via cut command. cut -c 2-5 file > temp1.txt cut -c 11-20 file >...

8. UNIX for Dummies Questions & Answers

Which command will be faster? y?

i)wc -c/etc/passwd|awk'{print $1}' ii)ls -al/etc/passwd|awk'{print $5}'

9. Shell Programming and Scripting

command faster in crontab..

Hi all you enlightened unix people, I've been trying to execute a perl script that contains the following line within backticks: `grep -f patternfile.txt otherfile.txt`;It takes normally 2 minutes to execute this command from the bash shell by hand. I noticed that when i run this command...

10. UNIX for Dummies Questions & Answers

sorting files with find command before sending to text file

i need help with my script.... i am suppose to grab files within a certain date range now i have done that already using the touch and find command (found them in other threads) touch -d "$date_start" ./tmp1 touch -d "$date_end" ./tmp2 find "$data_location" -maxdepth 1 -newer ./tmp1 !...

Login or Register to Ask a Question

LEARN ABOUT DEBIAN

flist

FLIST(1)							     [nmh-1.5]								  FLIST(1)

NAME

       flist, flists - list the number of messages in given sequence(s)

SYNOPSIS

       flist [+folder1 [+folder2 ...]]	[-sequence name1 [-sequence name2 ...]]  [-all | -noall] [-showzero | -noshowzero] [-recurse | -norecurse]
	    [-fast | -nofast] [-alpha | -noalpha] [-version] [-help]

       flists is equivalent to flist -all

DESCRIPTION

       Flist is used to search a list of folders and display the number of messages in these folders that are  in  a  given  sequence  or  set	of
       sequences (for example the "unseen" sequence). This is especially useful if you use some mechanism such as slocal or procmail (typically in
       conjunction with rcvstore) to pre-sort your mail into different folders before you view it.

       By default, the command flist will search the current folder for the given sequence or sequences (usually "unseen").  If  (possibly  multi-
       ple)  folders  are  specified  on the command line with +folder, then all these folders are searched for the given sequence(s).	Flist will
       display for each folder searched, the number of messages in each of the specified sequences, and the total number of messages.

       The option -sequence is used to specify the name of a sequence in which to search for.  This option may be used multiple times  to  specify
       multiple  sequences.   If this is not given, then the default is to search for all the sequences specified by the "Unseen-Sequence" profile
       component. For more details about sequences, read the mh-sequence(5) man page.

       Typically, flist will produce a line for each sequence, for every folder that is searched, even those which do not contain any messages	in
       the  given  sequence.   Specifying -noshowzero will cause flist to print only those folder/sequence combinations such the folder has a non-
       zero number of messages in the given specified sequence.

       If -recurse is given, then for each folder that is search, flist will also recursively descend into those folders to search subfolders  for
       the given sequence.

       If  -fast  is given, only the names of the folders searched will be displayed, and flist will suppress all other output.  If this option is
       used in conjunction with -noshowzero, then flist will only print the names of those folders searched that contain messages in in  at  least
       one of the specified sequences.

   Multiple Folders
       If  the	option	-all  is given (and no folders are specified with +folder), then flist will search all the folders in the top level of the
       users nmh directory.  These folders are all preceded by the read-only folders, which occur as "atr-cur-" entries in the user's nmh context.

       An example of the output of flist -all is:

	    /work/Mail	has  5 in sequence unseen (private); out of  46
	    inbox+	has 10 in sequence unseen	   ; out of 153
	    junklist	has  0 in sequence unseen	   ; out of  63
	    postmaster	has  1 in sequence unseen	   ; out of   3

       The "+" after inbox indicates that it is the current folder.

       The "private" flag indicates that the given sequence for that folder is private.  See the mh-sequence(5) man page for details about private
       sequences.

       If  the	option	-all  and +folder are both specified, then flist will search this folder, and all its first level subfolders for the given
       sequence.  You may specify multiple folders in this way.

       If flist is invoked by a name ending with "s" (e.g.  flists), then the switch -all is assumed by default.

       The sorting order for the listing is alphabetical (with -alpha), or in a priority order defined by the "Flist-Order"  profile  entry  (with
       -noalpha).   Each item in the "Flist-Order" is a folder name or a folder name pattern that uses * to match zero or more characters.  Longer
       matching patterns have precedence over shorter matching patterns.  For example:

	    Flist-Order: personal petproject mh* * admin *junk

       This order puts a few interesting folders first, such as those with mail addressed to you personally, those about a pet project, and  those
       about mh-related things.  It places uninteresting folders at the end, and it puts everything else in the middle in alphabetical order.

FILES

       $HOME/.mh_profile	  The user profile

PROFILE COMPONENTS

       Path:		    To determine the user's nmh directory
       mh-sequences:	    File that contains public sequences
       Unseen-Sequence:     The name of the unseen message sequence
       Flist-Order:	    To sort folders by priority

SEE ALSO

       folder(1), rcvstore(1), slocal(1), mh-sequence(5)

DEFAULTS

       `-sequence' defaults to Unseen-Sequence profile entry
       `-showzero'
       `-noall'
       `-norecurse'
       `-noalpha'
       `-nofast'

CONTEXT

       If  +folder  is	given,	it  will become the current folder.  If multiple folders are given, the last one specified will become the current
       folder.

MH.6.8								   11 June 2012 							  FLIST(1)