Shell Programming and Scripting

Still the DOS terminators persist...

Hello quincyjones,

Could you please try following and let me know if this helps you. This should remove if any carriage characters there and will provide the output as TAB delimited too.

Code:

awk '{gsub(/\r/,"");printf("%s\t",$1);for(i=2;i<=NF;i+=2){printf("%s%s",$i,i==NF?"":"\t")};print ""}'   Input_file

Thanks,
R. Singh

I have 12k columns and 200k rows. I am running this script using 60GB memory but it was failing. Is it it possible to run this more memory efficient? thanks @RavinderSingh13

The examples given should not be using much memory at all..

How was your script failing exactly?

sorry my bad. it is working fine.

Hello quincyjones,

Hard to believe that it uses 60 GB of memory, it's really a plenty of it?

Since I don't have that much size of Input_file so solution will be on assumption or a try only. In my previous solution I have put 1 condition which will check if variable i's value is equal to value of NF(Number of fields) or not, which was off course to NOT to have a TAB at last of line, since we are talking in terms of performance here then you could try to remove than condition and let me know, if you are ok with a TAB at last of line then let it be same code.

Code:

awk '{gsub(/\r/,"");printf("%s\t",$1);for(i=2;i<=NF;i+=2){printf("%s\t",$i)};print ""}'   Input_file

If you want to remove TAB at last of each line then you could add | awk '{sub(/[[:space:]]+$/,"");print}' after Input_file in above code I think that should be more faster than checking conditions in each fields etc. Kindly try it out and let me know how it goes then.

Thanks,
R. Singh