Hi Guys,

I've wondered for some time the performance analysis between using sed and awk. say i want to print lines from a very large file. For ex say a file with 100,000 records. i want to print the lines 25,000 to 26,000 i can do so by the following commands:

sed -n '25000,26000 p' filename

awk 'NR==25000,NR==26000' filename

It depends on your implementations of sed and awk, so isn't a certain thing. It can vary quite a lot, and our results may not be relevant to your system.

I'd be curious whether this is faster than your other awk expression: awk '(NR>=25000)&&(NR<=26000)

The surefire way to find out is to try...

And, of course, it may be possible to alter your program's logic such that you don't need to eat 25,000 useless lines before your program can start working... What exactly are you trying to do here?

i think your awk expression would be much faster:

awk '(NR>=25000)&&(NR<=26000)

I saw a thread recently where a similar question was asked, and performance shown for something like 4 or 5 different awk and sed implementations. The numbers were quite odd. There didn't seem to be any clear answer.

So, it really just comes down to what works better for you.

agreed mate. thanks for indulging me though !!

you could always try a comparison script to see how these are performing on your machine - e.g.

#!/bin/sh
time `sed -n '25000,26000 p' filename`
time `awk 'NR==25000,NR==26000' filename`
exit 0

When using shell "time" the backticks are not required as "time" is part of the shell syntax. Also, it is good to direct the output to /dev/null, while testing and the system cache needs to be taken into account, so that either all reads are from an already cached situation (so for example, perform all tests twice and take the latter resuls), or that you create provisions, so that there is no caching or caching is reset for every test.


--
The thread with different awks and greps can be found here. The speed difference between the various awk implementations can vary wildly..