Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Removing commas within semicolon in a flat file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Removing commas within semicolon in a flat file
# 22  
Old 06-20-2009
have you checked your output?
# 23  
Old 06-20-2009
Another approach:

Code:
awk 'BEGIN{FS=OFS="\""}
{for(i=2;i<NF;i+=2){sub(",","",$i)}}
1' file

# 24  
Old 06-20-2009
Quote:
Originally Posted by ghostdog74
have you checked your output?
Code:
yes I have but when using 

sed 's/\([^,]*\),\([^,]*\)/\1\2/g' file.txt 

I am getting correct output    # Iam using GNU/Linux

but when using 

sed '
{
:a
s/\([^,]*\),\([^,]*\)/\1\2/g
ta
}
' file.txt
it will also remove the , between fields.

# 25  
Old 06-20-2009
Quote:
Originally Posted by ahmad.diab
Code:
yes I have but when using 

sed 's/\([^,]*\),\([^,]*\)/\1\2/g' file.txt 

I am getting correct output    # Iam using GNU/Linux

but when using 

sed '
{
:a
s/\([^,]*\),\([^,]*\)/\1\2/g
ta
}
' file.txt
it will also remove the , between fields.

try this input
Code:
rohan,rahul,"kun,,al","sw,a,ti"
rohan,rahul,"k,un,al",swati
rohan,"rah,ul",kunal,swati
"ro,han",rahul,kunal,swati
rohan,rahul,kunal,swati



---------- Post updated at 07:05 AM ---------- Previous update was at 07:04 AM ----------
Quote:
Originally Posted by Franklin52
Another approach:

Code:
awk 'BEGIN{FS=OFS="\""}
{for(i=2;i<NF;i+=2){sub(",","",$i)}}
1' file

my output shows it doesn't take care of more than 1 commas as well
# 26  
Old 06-20-2009
Quote:
Originally Posted by ghostdog74
try this input
Code:
rohan,rahul,"kun,,al","sw,a,ti"
rohan,rahul,"k,un,al",swati
rohan,"rah,ul",kunal,swati
"ro,han",rahul,kunal,swati
rohan,rahul,kunal,swati



---------- Post updated at 07:05 AM ---------- Previous update was at 07:04 AM ----------



my output shows it doesn't take care of more than 1 commas as well
In that case:

Code:
awk 'BEGIN{FS=OFS="\""}{for(i=2;i<NF;i+=2){gsub(",","",$i)}}1' file

Regards
# 27  
Old 06-20-2009
Quote:
Originally Posted by Franklin52
In that case:

Code:
awk 'BEGIN{FS=OFS="\""}{for(i=2;i<NF;i+=2){gsub(",","",$i)}}1' file

Regards
that's right. great idea. ....now how do i give bits .......Smilie
Last edited by ghostdog74; 06-20-2009 at 09:23 AM..
# 28  
Old 06-20-2009
Quote:
Originally Posted by ghostdog74
that's right. great idea. ....now how do i give bits .......Smilie
Wow, do I earn that? Click on the award icon above the relating post ....Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Removing commas from CSV file

Hi I'm creating a sh script to generate a csv file. The CSV contains the values from a sql table. The content looks this: a,b,c,c2,c3,,,,,,,,,,,d,e I have some code that can separate the fields using the comma as delimiter, but some values actually contain commas, such as... (2 Replies)
Discussion started by: preema
2 Replies

2. Shell Programming and Scripting

Replace semicolon within double quotes in a file with semicolon delimiter

Hello Team, Could you please help me with the below question? I have a file with the following properties 1) File Delimiter is ; 2) Text columns are within double quotes 3) Numeric columns will not have double quotes 4) File has total 6 columns Please see a sample record from file ... (3 Replies)
Discussion started by: sam99
3 Replies

3. Shell Programming and Scripting

Removing just the trailing commas :-(

Hi all, I haven't needed to do any shell based editing for nearly 20 years, and no amount of searching around has found me a solution to this very simple problem :-( I have a csv file. Some lines have three commas at the end. This means the invoice hasn't been paid. I'd like to use sed / grep... (4 Replies)
Discussion started by: chardyzulu
4 Replies

4. Shell Programming and Scripting

Help with removing additional commas in string

Hi Experts, I have below strings hello,hi,,,,,,start date age,code,,,,,61,season I am trying to format this string to hello,hi,start date age,code,61,season Can anyone please help me in achieving this? Kind Regards, RB (3 Replies)
Discussion started by: ramakanth_burra
3 Replies

5. Shell Programming and Scripting

Removing commas within semicolon in a flat file

Hi , Im relatively new to unix and have to process a comma serparated flat file . I recieve some of the fields in double quotes and i want to remove it .. INPUT ==== filed1,field2,field3,"fie,ld4" OUTPUT ===== field1,field2,field3,"field4" can anyone tell me how to achieve... (10 Replies)
Discussion started by: r_t_1601
10 Replies

6. Shell Programming and Scripting

Need help in removing commas

i have the below line as output from a script. I want to delete the string "," and get the output without comma, cat D* | grep "bytes free" | awk '{print $3}' | ????? output: 40,966,189,056 Desired O/P: 40966189056 (1 Reply)
Discussion started by: ali560045
1 Replies

7. UNIX for Dummies Questions & Answers

removing semicolon using sed in aix--urgent

hi I have an expression aaabbb; xxx xxxi i need to get the ouput as xxx xxxi i am using sed -e 's/\(*;\)//g' but it is not working..?? can some one suggest.. This is urgent (9 Replies)
Discussion started by: aixjadoo
9 Replies

8. UNIX for Dummies Questions & Answers

Removing trailer from a flat file!!!

Hi, I get some flat files with trailer which gives the totol records count and i want to remove the trailer from the file. i used the following command it works fine with a single file. cat file_name | grep -v 'Total records:' > file1 mv file file_name But i dont know how to remove the... (12 Replies)
Discussion started by: kumarsaravana_s
12 Replies

9. HP-UX

Padding zeros after removing commas in file

Hi Gurus, There is a ASCII file in which a comma is used as a seperator for the amount field when the amount exceed seven digits: e.g. 0001300,000. Now, this comma needs to be removed from this field, after padding leading zeros (to maintain the ASCII positions) e.g. 00001300000.... (1 Reply)
Discussion started by: pranag21
1 Replies

10. UNIX for Dummies Questions & Answers

removing commas from text file

Dear all I have a file which looks like this xxxxxxxxxxxxxx,xxx,xxxxxxxxxx xxxxxxxxxxxxxx,xxx,xxxxxxxxxx etc basically 14 characters then a comma, three characters, then a comma then 10 characters. We are uploading this file to our mainframe and they want the commas removed, so it... (6 Replies)
Discussion started by: hcclnoodles
6 Replies
Login or Register to Ask a Question