Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Replace double quotes with a single quote within a double quoted string

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Replace double quotes with a single quote within a double quoted string
# 15  
Old 05-05-2014
Wonder if this would perform the wanted task

Code:
perl -wple 's/(\w)"(\w)/$1\x27$2/g' wrong_quoted.file > right_quoted.file

# 16  
Old 05-05-2014
Code:
awk -v q="'" 'BEGIN{FS = OFS = ","}
  {for(i = 1; i <= NF; i++)
    {n = length($i);
    if(n > 1 && $i ~ /^\".*\"$/)
      T = substr($i, 2, n-2)
    gsub(/\"/, q, T)
    if(length(T) + 2 == n)
      $i = ("\"" T "\"")}}1' file

# 17  
Old 05-05-2014
Hopefully, comma's are not allowed within double quotes Smilie ...
Code:
awk -F, '{for(i=1; i<=NF; i++) {s=$i; if(gsub(/^"|"$/,x,s)==2 && gsub(d,q,s)) $i=d s d}}1' OFS=, q=\' d=\" file

--edit--
OK, just noticed the approach is similar to SriniShoo's ...
Last edited by Scrutinizer; 05-05-2014 at 06:06 AM..
# 18  
Old 05-05-2014
Thank you for all your feedback
My requirement is simple - I have an csv input file with some string fields enclosed with double quotes.

If any double quotes (data) appear in the string field, I want to replace with a single quote.

Can the script be generic enough so that it will solve any number of text strings in a record?

Thanks.
# 19  
Old 05-05-2014
Quote:
Originally Posted by pchang
My requirement is simple
As we have established in the first posts in this thread the task looks simple, but isn't. Take your pick among most of the answers here, try them on sample data and report back in which way they fail (if they fail at all) or that they are doing what you want, respectively. Probably the biggest difference will be the runtime: the fewer programs are involved and the more builtin shell functions are used the faster it will generally execute.

Quote:
Originally Posted by pchang
Can the script be generic enough so that it will solve any number of text strings in a record?
As far as i could see at a passing glance none of the suggeted solutions is limited in this regard. Probably execution time will differ but the difference will probably not be noticeable until you process thousands of lines. So just try it out, stop the time and find out yourself.

bakunin
# 20  
Old 05-05-2014
I don't understand the commotion, a simple sed would suffice, no?
Code:
 
$ sed 's/\([^,]\)\"\([^,]\)/\1\x27\2/g' file
0000001111,"IBD","601725","6017257000681563","0430","163458","002820","002820000000","E0107815","1801 3E AVENUE         VAL-D'OR
 QCCA","0200","","","WD","CH","","4000320275","","124","124",,60.00,60.00,60.00,0.00,0.45,60.45,0.037500,"APP","00","EXC","5"

# 21  
Old 05-05-2014
Quote:
Originally Posted by Subbeh
I don't understand the commotion, a simple sed would suffice, no?
Code:
 
$ sed 's/\([^,]\)\"\([^,]\)/\1\x27\2/g' file
0000001111,"IBD","601725","6017257000681563","0430","163458","002820","002820000000","E0107815","1801 3E AVENUE         VAL-D'OR
 QCCA","0200","","","WD","CH","","4000320275","","124","124",,60.00,60.00,60.00,0.00,0.45,60.45,0.037500,"APP","00","EXC","5"

Thank you Subdeh - I decided to try your code (since it looks the most simplest) but I didn't get the expected output. Instead of a single quote, I got x27. Please see sample data below:

Input data:
Code:
0000001111,"IBD","601725","6017257000681563","0430","163458","002820","002820000000","E0107815","1801 3E AVENUE         VAL-D"OR     QCCA","0200","","","WD","CH","","4000320275","","124","124",,60.00,60.00,60.00,0.00,0.45,60.45,0.037500,"APP","00","EXC","5"

Output data:
Code:
0000001111,"IBD","601725","6017257000681563","0430","163458","002820","002820000000","E0107815","1801 3E AVENUE         VAL-Dx27OR     QCCA","0200","","","WD","CH","","4000320275","","124","124",,60.00,60.00,60.00,0.00,0.45,60.45,0.037500,"APP","00","EXC","5"
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Replace double quotes inside the string data for all the columns

Please use code tags Hi, I have input data is below format and n of column in the multiple flat files. the string data has any double quotes(") values replaced to double double quotes for all the columns{""). Also, my input flat file each column string data has carriage of new line too.... (14 Replies)
Discussion started by: SSrini
14 Replies

2. Shell Programming and Scripting

Replacing all but the first and last double quote in a line with a single quote with awk

From: 1,2,3,4,5,This is a test 6,7,8,9,0,"This, is a test" 1,9,2,8,3,"This is a ""test""" 4,7,3,1,8,"""" To: 1,2,3,4,5,This is a test 6,7,8,9,0,"This; is a test" 1,9,2,8,3,"This is a ''test''" 4,7,3,1,8,"''"Is there an easy syntax I'm overlooking? There will always be an odd number... (5 Replies)
Discussion started by: Michael Stora
5 Replies

3. Shell Programming and Scripting

Replace Double quotes within double quotes in a column with space while loading a CSV file

Hi All, I'm unable to load the data using sql loader where there are double quotes within the double quotes As these are optionally enclosed by double quotes. Sample Data : "221100",138.00,"D","0019/1477","44012075","49938","49938/15043000","Television - 22" Refurbished - Airwave","Supply... (6 Replies)
Discussion started by: mlavanya
6 Replies

4. Shell Programming and Scripting

sed command to replace string that contain blackslash,double quotes

Hi All, I have been trying to replace a string using the sed command string value contain blackslash and double quotes. I am not a expert writer of unix script but do try not to ask question. I have almost given up. Hope you all can give me some suggestion I want to replace a place string... (6 Replies)
Discussion started by: thanush9sep
6 Replies

5. Shell Programming and Scripting

Issue with Single Quotes and Double Quotes for prompt PS1

Hi, Trying to change the prompt. I have the following code. export PS1=' <${USER}@`hostname -s`>$ ' The hostname is not displayed <abc@`hostname -s`>$ uname -a AIX xyz 1 6 00F736154C00 <adcwl4h@`hostname -s`>$ If I use double quotes, then the hostname is printed properly but... (3 Replies)
Discussion started by: bobbygsk
3 Replies

6. Shell Programming and Scripting

Replace double double quotes using AWK/SED

Hi, I have data as "01/22/97-"aaaaaaaaaaaaaaaaa""aaa""aabbbbbbbbcccccc""zbcd""dddddddddeeeeeeeeefffffff" I want to remove only the Consequitive double quotes and not the one which occurs single. My O/P must be ... (2 Replies)
Discussion started by: Bhuvaneswari
2 Replies

7. Shell Programming and Scripting

Replace single quote with two single quotes in perl

Hi I want to replace single quote with two single quotes in a perl string. If the string is <It's Simpson's book> It should become <It''s Simpson''s book> (3 Replies)
Discussion started by: DushyantG
3 Replies

8. Shell Programming and Scripting

Regex in grep to match all lines ending with a double quote (") OR a single quote (')

Hi, I've been trying to write a regex to use in egrep (in a shell script) that'll fetch the names of all the files that match a particular pattern. I expect to match the following line in a file: Name = "abc" The regex I'm using to match the same is: egrep -l '(^) *= *" ** *"$' /PATH_TO_SEARCH... (6 Replies)
Discussion started by: NanJ
6 Replies

9. Shell Programming and Scripting

Double quotes or single quotes when using ssh?

I'm not very familiar with the ssh command. When I tried to set a variable and then echo its value on a remote machine via ssh, I found a problem. For example, $ ITSME=itsme $ ssh xxx.xxxx.xxx.xxx "ITSME=itsyou; echo $ITSME" itsme $ ssh xxx.xxxx.xxx.xxx 'ITSME=itsyou; echo $ITSME' itsyou $... (3 Replies)
Discussion started by: password636
3 Replies

10. Shell Programming and Scripting

single or double quote in SED

i m trying the following command but its not working: sed 's/find/\'replace\'/g' myFile but the sed enters into new line # sed 's/find/re\'place/g' myFile > I havn't any idea how to put single quote in my replace string. Your early help woud be appreciated. Thanx (2 Replies)
Discussion started by: asami
2 Replies
Login or Register to Ask a Question