remove unnecessary comma from file


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users remove unnecessary comma from file
# 1  
Old 12-31-2008
remove unnecessary comma from file

HI all,

I have a file with following data - test1

"ABC,D",1234,"XYZ,QWER",1234
"SZXA",9870,"ASD,QWERT",234
"XZ,SD",9478,"ADCS,AXZ",876
"WESR",8764,"AQZXAS",9888
"WESR",9898,"WESDRTSAW",3323

I need to get rid of unnecessary commas in fields having double quotes.

Ouput -

"ABCD",1234,"XYZQWER",1234
"SZXA",9870,"ASDQWERT",234
"XZSD",9478,"ADCSAXZ",876
"WESR",8764,"AQZXAS",9888
"WESR",9898,"WESDRTSAW",3323


I am trying follwing but of no avail.

sed 's/\,/\"^["]*\"' test1
sed: 0602-404 Function s/\,/\"^["]*\" cannot be parsed.

I work on AIX.

Any help is appreciated.

Thanks
Sumeet
# 2  
Old 12-31-2008
Hi,

try:
command:
Code:
sed 's/\("[^"][^,]*\),\([^"]*[^,]"\)/\1\2/g' commafile

input:
Code:
"ABC,D",1234,"XYZ,QWER",1234
"SZXA",9870,"ASD,QWERT",234
"XZ,SD",9478,"ADCS,AXZ",876
"WESR",8764,"AQZXAS",9888
"WESR",9898,"WESDRTSAW",3323

output:
Code:
"ABCD",1234,"XYZQWER",1234
"SZXA",9870,"ASDQWERT",234
"XZSD",9478,"ADCSAXZ",876
"WESR",8764,"AQZXAS",9888
"WESR",9898,"WESDRTSAW",3323

HTH Chris
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to remove comma?

hi all, in the 3rd field i am having comma. can anyone tell me how to remove the comma in the 3rd field and 4th field. |1.77|0.1|1,335.20|3,513.30|190|7.00 |4.40 |2.50 |1|1|5|5|Section903-Liquor|StLouis|0||||||||||| 40997|9999999|9999999|195186280|0102796|36949|00083089660358|2016|MAY ... (2 Replies)
Discussion started by: arun888
2 Replies

2. Shell Programming and Scripting

Shell script that should remove unnecessary commas between double quotes in CSV file

i have data as below 123,"paul phiri",paul@yahoo.com,"po.box 23, BT","Eco Bank,Blantyre,Malawi" i need an output to be 123,"paul phiri",paul@yahoo.com,"po.box 23 BT","Eco Bank Blantyre Malawi" (5 Replies)
Discussion started by: mathias23
5 Replies

3. Shell Programming and Scripting

How to remove last comma?

Hi Gurus, I have file like below: a b c d .. I want to get 'a','b','c', 'd' I try to use below command to get it, but I got one extra comma sed "s/.*/'&'/" code_LIST.txt |tr -s '\n' "," I got below result: 'a','b','c','d', there is one extra comma at end of the line. How can I... (10 Replies)
Discussion started by: ken6503
10 Replies

4. Shell Programming and Scripting

How to Remove comma as last character in end of last line of file?

how to Remove comma as last charector in end of last line of file: example: input file --------------- aaaaaa, bbbbbb, cccc, 12345, ____________ output file : ----------- aaaaaa, bbbbbb, (6 Replies)
Discussion started by: RahulJoshi
6 Replies

5. UNIX for Dummies Questions & Answers

Remove First Char from Line in File Only if it's a comma

I have a file, I need to remove the first character of each line, but only if it's a comma. I don't want to delete any other commas in each line. Trying cat or sed but I really don't know them very well, would love some help. This removes the first comma, but it removes the first comma no... (6 Replies)
Discussion started by: Cynthia
6 Replies

6. Shell Programming and Scripting

Removing unnecessary Delimiters from a file

Hi all, I have a pipe delimited file - (sample data) 1|1|K|Doe|1234567890|123456789|EXP|99|99|John|Y|Dallas|Texas|Kyle|999 2|1|A|2|01/01/9999|Appl|01/01/9999|vendor|Select|||||| 3|1|A|2|01/01/9999|Check|01/01/9999|ksmith|Suggest|||||| 4|1|T|Complaint|Mary|01/01/9999|01/01/9999|||||||... (2 Replies)
Discussion started by: sumeet
2 Replies

7. UNIX for Dummies Questions & Answers

How to remove comma from the last line of the file

Hi, I have a file which has records which end with a comma. for example: My file looks like 1234, 5678, 3455, 3566, 4444, 9999, I need to remove comma for the last line in the file so that my file should look like: 1234, 5678, 3455, (5 Replies)
Discussion started by: sandeep_1105
5 Replies

8. UNIX for Dummies Questions & Answers

Remove whitespaces between comma separated fields from file

Hello all, I am a unix dummy. I am trying to remove spaces between fields. I have the file in the following format 12332432, 2345 , asdfsdf ,100216 , 9999999 12332431, 2341 , asdfsd2 ,100213 , 9999999 &... (2 Replies)
Discussion started by: nitinbjoshi
2 Replies

9. UNIX for Dummies Questions & Answers

Comparing filename-substrings and remove unnecessary files

hi folks... i have to write a sript that removes unnecessary backup-files. iam new to shell scripting so please be patient with me. and no its not homework :p these files look like "javacore303330.1209029863.txt" where the first number is the PID and the second is the timestamp. so there can be... (5 Replies)
Discussion started by: cypher82
5 Replies

10. UNIX for Dummies Questions & Answers

remove unnecessary lines

If I have a file with 5000 lines contains numbers. Some of the number are repeated and some are not. Among those repeated number, I only would like to keep only one. How do I remove those balance repeated number. Your help is much appreciated. Thank you. (3 Replies)
Discussion started by: nazri
3 Replies
Login or Register to Ask a Question