SORT Cammand


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting SORT Cammand
# 1  
Old 04-19-2006
SORT Cammand

Hi every body,
What is the limitation of UNIX command sort that related to file size? In other words, what is the maximum file size that sort command can process?
# 2  
Old 04-21-2006
I don't know that the sort command has any theoretical limit to the file size. It more likely would depend on the maximum size file your system can create (assuming you aren't just writing the results to standard output). Try 'ulimit' to determine the maximum file size. If it's unlimited, then it's a matter of disk space and cpu time.
# 3  
Old 04-21-2006
Like Glen I believe sort is limited to what the OS supports, ie., largefiles > 2.4GB or no largefiles.

sort does require temporary file space - usually in either /var/tmp or /tmp. If there is not enough free space - about equal to the size of the input file - sort may fail.
sort will also fail with the -c or -m option when you have really long recordlengths in an input file on a merge-only operation.

What error are you getting?
# 4  
Old 04-21-2006
Don't know what your getting for an error, but most likely if you're experiencing a problem with a large file you may need to select a filesystem with more disk space for your sortwork (Temp) space. Do a df to determine where you have space for sortwork, then use the -T option to specify the temp directory.
e.g. sort -k1 -T /data/work mi_grande_file.txt >mi_grande_file.txt.srtd
# 5  
Old 04-22-2006
Thanks every body,
When I specified the Temp directory, the command work fine on files that was results in error before.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Use sort to sort numerical column

How to sort the following output based on lowest to highest BE? The following sort does not work. $ sort -t. -k1,1n -k2,2n bfd.txt BE31.116 0s 0s DOWN DAMP BE31.116 0s 0s DOWN DAMP BE31.117 0s 0s ... (7 Replies)
Discussion started by: sand1234
7 Replies

2. UNIX for Beginners Questions & Answers

Difference of Sort -n -k2 -k3 & Sort -n -k2,3

Hi, Could anyone kindly show me a link or explain the difference between sort -n -k2 -k3 & sort -n -k2,3 Also, if I like to remove the row with repetition at both $2 and $3, Can I safely use sort -u -k2 -k3 Example; 100 20 30 100 20 30 So, both $2 and $3 are same and I... (2 Replies)
Discussion started by: Indra2011
2 Replies

3. Shell Programming and Scripting

Sort help: How to sort collected 'file list' by date stamp :

Hi Experts, I have a filelist collected from another server , now want to sort the output using date/time stamp filed. - Filed 6, 7,8 are showing the date/time/stamp. Here is the input: #---------------------------------------------------------------------- -rw------- 1 root ... (3 Replies)
Discussion started by: rveri
3 Replies

4. Shell Programming and Scripting

Help with sort word and general numeric sort at the same time

Input file: 100%ABC2 3.44E-12 USA A2M%H02579 0E0 UK 100%ABC2 5.34E-8 UK 100%ABC2 3.25E-12 USA A2M%H02579 5E-45 UK Output file: 100%ABC2 3.44E-12 USA 100%ABC2 3.25E-12 USA 100%ABC2 5.34E-8 UK A2M%H02579 0E0 UK A2M%H02579 5E-45 UK Code try: sort -k1,1 -g -k2 -r input.txt... (2 Replies)
Discussion started by: perl_beginner
2 Replies

5. Shell Programming and Scripting

Alternate to sort --random-sort

sort --random-sort The full command is path=`find /testdir -maxdepth 1 -mindepth 1 -type d | ***Some sort of sort function*** | head -1` I have a list I want to randomly sort. It works fine in ubuntu but on a 'osx lion' sort dosen't have the --random-sort option. I don't want to... (5 Replies)
Discussion started by: digitalviking
5 Replies

6. Shell Programming and Scripting

Is it Possible to sort a list of hexadecimal numbers using "sort" command?

Hello Everybody :) !!!. i have question in mind, is it possible to sort a list of hexadecimal numbers using "sort" command? (9 Replies)
Discussion started by: Kesavan
9 Replies

7. UNIX for Advanced & Expert Users

Script to sort the files and append the extension .sort to the sorted version of the file

Hello all - I am to this forum and fairly new in learning unix and finding some difficulty in preparing a small shell script. I am trying to make script to sort all the files given by user as input (either the exact full name of the file or say the files matching the criteria like all files... (3 Replies)
Discussion started by: pankaj80
3 Replies

8. Shell Programming and Scripting

Passing wildcards to cammand line arguments

I have a csh script plot-model.csh I want to be able to pass wildcards for the input file names such as ./plot-model.csh *8x6smp.cmod Currently I have to pass the full files names one after each other which I then store in a list. Then I proceed to plot the data within it. Now I... (7 Replies)
Discussion started by: kristinu
7 Replies

9. Shell Programming and Scripting

How to Sort Floating Numbers Using the Sort Command?

Hi to all. I'm trying to sort this with the Unix command sort. user1:12345678:3.5:2.5:8:1:2:3 user2:12345679:4.5:3.5:8:1:3:2 user3:12345687:5.5:2.5:6:1:3:2 user4:12345670:5.5:2.5:5:3:2:1 user5:12345671:2.5:5.5:7:2:3:1 I need to get this: user3:12345687:5.5:2.5:6:1:3:2... (7 Replies)
Discussion started by: daniel.gbaena
7 Replies

10. UNIX for Dummies Questions & Answers

bc cammand in UNIX

Can some one please explain the correct syntax of the bc command to me. The UNIX man bc does not show you much. Regards Wolf :cool: (4 Replies)
Discussion started by: wolf
4 Replies
Login or Register to Ask a Question