Shell Programming and Scripting

Hi Corona,
Thanks a lot.!!
Actually filename was not getting printed.
I had a similar problem for which i had found the soultion on this forum itself.
The code looks like this now.

Code:

awk -v ORS="" 'FNR==1 { printf(FILENAME"\n") }; /<.*/ , /.*<\/.*>/' *.txt

Big thanks to all you guys here.

Thanks,
Chetan.C

Oh, I didn't realize you wanted the filename either, sorry. Your original didn't have that. This is why I prefer people tell me what they actually want, rather than "how do I make this piece of code run faster" -- I'm liable to make bad guesses about their requirements.

Glad you got it working!

Hi.
+1 ... cheers, drl

Thanks Corona.

Yes will make sure i will post it right next time.

Hi,

The script which im running is executed simultaneously for multiple folders.
So is there a chance of overlapping of data beacause of this multiple process?

Im seeing overlapping of data here.
am i doing something wrong?

Thanks,
Chetan.C

---------- Post updated at 06:04 AM ---------- Previous update was at 04:56 AM ----------

This is the code

Code:

 
#!/bin/bash 
　
function fast {
cd $1
awk -v ORS="" 'FNR==1 { printf("\n"FILENAME"\n") }; /<.*/ , /.*<\/.*>/' *.txt
}
for dir in `find /opt/app/idss/data01/cc002h/computes/test_scripts/Test_files/ -type d -name "TLT*"`; do
fast $dir &
done
wait

It's overlapping because they're running literally at the same time -- i.e, what you asked for. Save their output to separate files, combine them later. That will possibly negate any benefit of paralleling them, though, since you'll be doing two to three times as much disk access for the same amount of work!

I continue to not believe there's incredibly large benefits to parallelizing this. Having 9 programs instead of 1 won't let the 9 programs read from your disk 9 times faster. Measure what throughput you have already, first.

Hi Corona,

Thanks a lot.
So overlapping does happen in these cases.

The problem here is i want to process a lot number of files so i wanted to try to make process more number of files.

I completely understand your take on I/O but have to speed up the processing,so im trying out the I/O itself.

Please let me know if there is something else that i can try.

Thanks a lot for you replies.

Thanks,
Chetan.C