UNIX for Dummies Questions & Answers

Hi,

I have a file with fixed number of columns (total 58 columns) delimeted by pipe (|). Due to a bug in the application the export file does not come with fixed number of columns. The missing data columns are being replaced by blank in the output file. In one line I can have 25 columns (33 columns blank) populated and in next one I can have 57 columns (1 column blank) populated. I need to fill blanks with '|0' (pipe zero) in each line to make 58 columns.

Example (with 10 columns):

Input file:

Code:

Dec_2011|Test|10|20|30|40|50|60|70|80
Dec_2011|Test|10|20|30
Dec_2011|Test|10
Dec_2011|Test|10|20|30|40|50|60


Output file:
Dec_2011|Test|10|20|30|40|50|60|70|80
Dec_2011|Test|10|20|30|0|0|0|0|0
Dec_2011|Test|10|0|0|0|0|0|0|0
Dec_2011|Test|10|20|30|40|50|60|0|0

File is very big (1 GB) so we have to take care of performace also. It is better if this does not run for hours and hours. Thanks for your help.

Code:

awk -F '|'  '{ x=58 - NF; for(; x>0; x--) {$0=$0 "|0"}; print $0 } ' inputfile > outputfile

Try that, awk is an efficient language.