Shell Programming and Scripting

Since you're running on Windows, it may be that your input file's lines are terminated by a carriage return character and a newline character. Since awk is expecting just newline as the line terminator, the search for a comma at the end of a line fails because there is a carriage return character following the comma. To verify this, show us the first few lines of output from:

Code:

od -bc Your_Input_File

Assuming that output contains some sequences like \r (indicating carriage return characters), try the following:

Code:

awk '{gsub(/\r/, "")}/,$/{printf("%s",$0);next}1' Your_Input_File > Your_Output_File

or, if your output file has to have carriage return and newline terminators:

Code:

awk '{gsub(/\r/, "")}/,$/{printf("%s",$0);next}{printf("%s\r\n", $0)}' Your_Input_File > Your_Output_File

There are also (single) quoting issues with awk on Windows, I seem to recall. He may need to run it as

Code:

awk "{while(NF<12){getline p; \$0=\$0 p}}1" FS=, OFS=, file

or something or put the script in a file.....

Thanks a lot Ahamed.

I used the below to autocorrect and it worked

Code:

 
perl -pi -e 's/,\r+\n//g;s/\n,/,/g' ' infile.

I have few more queries

below is the description of what i'm working on.

>There will be a directory with more than 5+ .csv files
> One or more files will sometimes have this issue

What needs to be done is
> I dont what to overwrite in the original file.
>I want to retain the original file.

how to proceed?

Thanks,
Karthik

This is the reason why we ask to post the OS details in the first place.

For your second query, remove the -i option and redirect it to another file or

Code:

perl -pi.orig -e 's/,\r+\n//g;s/\n,/,/g' infile

which will create a backup file with extension .orig

--ahamed

But the problem is what if the broken line is like this where the it is starting with a comma(,) like this?

Code:

 
 
abcd,732656,20140211,20140202,58461.10
,C,INR,,,Settlement of purchase.,,1

This code wont work in such cases.

How to modify the code to work in both cases?

You need to similarly modify the second statement after ;

--ahamed

how?
Sorry i'm very new to unix!!