faster command than find for sorting?

Login or Register to Ask a Question and Join Our Community

faster command than find for sorting?

Tags

Login to Discuss or Reply to this Discussion in Our Community

Top Forums Shell Programming and Scripting faster command than find for sorting?

02-09-2010

Registered User

116, 2

Join Date: Nov 2008

Last Activity: 18 November 2015, 1:00 PM EST

Posts: 116

Thanks Given: 14

Thanked 2 Times in 2 Posts

faster command than find for sorting?

I'm sorting files from a source directory by size into 4 categories then copying them into 4 corresponding folders, just wondering if there's a faster/better/more_elegant way to do this:

Code:

find /home/user/sourcefiles -type f -size -400000k -exec /bin/cp -uv {} /home/user/medfiles/ \;
find /home/user/medfiles -type f -size -200000k -exec /bin/mv {} /home/user/smallfiles/ \;
find /home/user/sourcefiles -type f -size +400000k -exec /bin/cp -uv {} /home/user/reallybigfiles/ \;
find /home/user/reallybigfiles -type f -size -1000000k -exec /bin/mv {} /home/user/bigfiles/ \;

I have 570G of source files and need to sync updates about every hour, I update the sourcefiles using rsync and then run this to sort them.

unclecameron

View Public Profile for unclecameron

Find all posts by unclecameron

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to make awk command faster?

I have the below command which is referring a large file and it is taking 3 hours to run. Can something be done to make this command faster. awk -F ',' '{OFS=","}{ if ($13 == "9999") print $1,$2,$3,$4,$5,$6,$7,$8,$9,$10,$11,$12 }' ${NLAP_TEMP}/hist1.out|sort -T ${NLAP_TEMP} |uniq>...

2. Shell Programming and Scripting

Recursive folder search faster than find?

I'm trying to find folders created by a propritary data aquisition software with the .aps ending--yes, I have never encountered folder with a suffix before (some files also end in .aps) and sort them by date. I need the whole path ls -dt "$dataDir"*".aps"does exactly what I want except for the...

3. Solaris

Monitoring log file for entries - Find command & sorting

hi, I would like to monitor a log file, which rolls over, everytime a server is restarted. I would like to grep for a string, and to be more efficient i'd like to grep only newly appended data. so something like a 'tail -f' would do, however, as the log rolls over i think a 'tail -F' is...

4. UNIX for Dummies Questions & Answers

A faster equivalent for this sed command

Hello guys, I'm cleaning out big XML files (we're talking about 1GB at least), most of them contain words written in a non-latin alphabet. The command I'm using is so slow it's not even funny: cat $1 | sed -e :a -e 's/<*>//g;/</N;//ba;s/</ /g;s/>/...

5. Shell Programming and Scripting

Faster way to use this awk command

awk "/May 23, 2012 /,0" /var/tmp/datafile the above command pulls out information in the datafile. the information it pulls is from the date specified to the end of the file. now, how can i make this faster if the datafile is huge? even if it wasn't huge, i feel there's a better/faster way to...

6. HP-UX

Faster command for file copy than cp ?

we have 30 GB files on our filesystem which we need to copy daily to 25 location on the same machine (but different filesystem). cp is taking 20 min to do the copy and we have 5 different thread doing the copy. so in all its taking around 2 hr and we need to reduce it. Is there any...

7. Shell Programming and Scripting

HELP need to split this line faster than cut-command

Hi, A datafile containing lines such as below needs to be split: 500000000000932491683600000000000000000000000000016800000GS0000000000932491683600*HOME I need to get the 2-5, 11-20, and 35-40 characters and I can do it via cut command. cut -c 2-5 file > temp1.txt cut -c 11-20 file >...

8. UNIX for Dummies Questions & Answers

Which command will be faster? y?

i)wc -c/etc/passwd|awk'{print $1}' ii)ls -al/etc/passwd|awk'{print $5}'

9. Shell Programming and Scripting

command faster in crontab..

Hi all you enlightened unix people, I've been trying to execute a perl script that contains the following line within backticks: `grep -f patternfile.txt otherfile.txt`;It takes normally 2 minutes to execute this command from the bash shell by hand. I noticed that when i run this command...

10. UNIX for Dummies Questions & Answers

sorting files with find command before sending to text file

i need help with my script.... i am suppose to grab files within a certain date range now i have done that already using the touch and find command (found them in other threads) touch -d "$date_start" ./tmp1 touch -d "$date_end" ./tmp2 find "$data_location" -maxdepth 1 -newer ./tmp1 !...

Login or Register to Ask a Question

LEARN ABOUT PHP

yaz_sort

YAZ_SORT(3)								 1							       YAZ_SORT(3)

yaz_sort - Sets sorting criteria

SYNOPSIS

       void yaz_sort (resource	$id, string  $criteria)

DESCRIPTION

	This function sets sorting criteria and enables Z39.50 Sort.

	Call this function beforeyaz_search(3). Using this function alone does not have any effect. When used in conjunction with yaz_search(3), a
       Z39.50 Sort will be sent  after	a  search  response  has  been	received  and  before  any  records  are  retrieved  with  Z39.50  Present
       (yaz_present(3).

PARAMETERS

	      o $id
		- The connection resource returned by yaz_connect(3).

	      o $criteria
		- A string that takes the form field1 flags1 field2 flags2 where field1 specifies the primary attributes for sort, field2 seconds,
		etc..  The field specifies either a numerical attribute combinations consisting of  type=value	pairs  separated  by  comma  (e.g.
		1=4,2=1)  ;  or  the  field  may specify a plain string criteria (e.g.	title. The flags is a sequence of the following characters
		which may not be separated by any white space.

		     Sort Flags

		     o a - Sort ascending

		     o d - Sort descending

		     o i - Case insensitive sorting

		     o s - Case sensitive sorting

RETURN VALUES

	No value is returned.

EXAMPLES

       Example #1

	      Sort Criterias

	       To sort on Bib1 attribute title, case insensitive, and ascending you would use the following sort criteria:

	      1=4 ia

	       If the secondary sorting criteria should be author, case sensitive and ascending you would use:

	      1=4 ia 1=1003 sa

PHP Documentation Group 													       YAZ_SORT(3)