Search Results

Hi.

You may wish to look over the documentation for msort. It has numerous options that standard sort does not. Some might be useful for your task:
msort - sort records in complex ways...

I wrote a "locality of reference" sort once: mmap64() the file and start sorting by making 2 lists of one line, then a linked list of 2 lines sorted, twice, and then merge them, then again, then...

There is no way for me to know if this will help at all, but I had some fun playing. All of this was on a 16 core 16GB desktop running Cygwin. Linux often performs better on some things because...

Did you perhaps intend to use:
export SORT="--batch-size=1000 --buffer-size=10g"
instead of setting the buffer size twice?

One obvious way to use all your CPUs is to split the file into N hunks, use a sort on each and pipe their output to "sort -m <pipe1> . . . <pipeN>". It helps if the file is a regular array, or can be...