Visit The New, Modern Unix Linux Community


Replace double quotes with a single quote within a double quoted string


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Replace double quotes with a single quote within a double quoted string
# 29  
Hi subbeh...
Again without knowing anything about the OPs data then there could be something like .......,",....... from an accidental typo input as it WILL still create an odd number of inverted commas, (double quotes)...
None of us have accounted for it in any code written so far...
Code:
Last login: Mon May  5 21:47:34 on ttys000
AMIGA:barrywalker~> echo '1234,"","qwerty",," abcd efg "h" bcd"efg
>   dfg",","","5"' > /tmp/text
AMIGA:barrywalker~> sed -e :a -e "s/\([^,]\)\"\([^,]\)/\1'\2/g;ta" < /tmp/text
1234,"","qwerty",," abcd efg 'h' bcd'efg
  dfg",","","5"
AMIGA:barrywalker~> #  dfg",","","5"
AMIGA:barrywalker~> # Error ^ here?
AMIGA:barrywalker~> # We have no idea from the OP if this will ever occur.
AMIGA:barrywalker~> _

# 30  
Quote:
Originally Posted by wisecracker
Hi subbeh...
Again without knowing anything about the OPs data then there could be something like .......,",....... from an accidental typo input as it WILL still create an odd number of inverted commas, (double quotes)...
None of us have accounted for it in any code written so far...
Hi wisecracker, I think I understand the OPs request quite clearly the way he described it. And although you make a valid point, I consider it as a data entry issue which I think is out of scope here.
This User Gave Thanks to Subbeh For This Post:
# 31  
Nice solution Subbeh

I think this an awk equivalent:

Code:
awk '{
   for(i=2;length(v=substr($0,i++,2));)
      if (v==",\"") i++
      else if(v ~ "\"[^,]") $0=substr($0,1,i-2) "\x27" substr($0,i)
}1' file

---------- Post updated at 08:29 AM ---------- Previous update was at 08:17 AM ----------

Or using GNU awk:

Code:
awk '{while((t=gensub(/([^,])"([^,])/, "\\1\x27\\2",$0))!=$0)$0=t}1' file

This User Gave Thanks to Chubler_XL For This Post:
# 32  
Hi @wisecracker, i just wanted tho show a practical usage of look-ahead/behid assertion, for me the important thing here is not the print statement and of course i can't guarantee python in all *nix boxes.

Also i didn't take care of just single double quotes fields.

Cheers.

Quote:
Originally Posted by wisecracker
Hi klashxx...

Just a couple of points here.
1) It looks as though you are using Python 2.x, (2.7.x), so your print statement would not
work on 3.x.x. Parentheses are needed to make 'print' a function 'print(your stuff here)'
2) Can you guarantee that all UNIX, Linux, CygWin etc, systems have a python version?

EDIT:-
To the OP is the part above the ^ character an error?
Code:
Last login: Mon May  5 19:09:15 on ttys000
AMIGA:barrywalker~> python
Python 2.7.1 (r271:86832, Aug  5 2011, 03:30:24) 
[GCC 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2335.15.00)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import re
>>> text='''1234,"","qwerty",," abcd efg "h" bcd"efg
...  dfg",","","5"'''
>>> print text
1234,"","qwerty",," abcd efg "h" bcd"efg
 dfg",","","5"
>>> 
>>> 
>>> print re.sub(r'(?<![,\A])"(?!(?:(,|\Z)))',"'",text)
1234,"","qwerty",," abcd efg 'h' bcd'efg
 dfg",","","5"
>>> # ^ is this an error?
... # Should it be a "'"?
... 
>>> exit()
AMIGA:barrywalker~> _

This User Gave Thanks to Klashxx For This Post:
# 33  
Sample awk translator
Code:
cat translator.awk
 
BEGIN { FS="," }
{
  for (i=1; i<=NF; i++) {
    printf "%s", translateEmbeddedQuote($i)
    if ( i< NF ) printf ","
    else printf "\n"
  }
}
function translateEmbeddedQuote(s, m,ts) {
  m=match(s,/^".*"$/)
  if (m) ts=substr(s, 2, length(s)-2 )
  else ts=s
  if (length(s)>1) gsub("\"","'",ts)
  if (m) ts="\"" ts "\""
  return ts
}

Input data:
Code:
cat valdor.txt
0000001111,"IBD","601725","6017257000681563","0430","163458","002820","002820000000","E0107815","1801 3E AVENUE         VAL-D"OR QCCA","0200","","","WD","CH","","4000320275","","124","124",,60.00,60.00,60.00,0.00,0.45,60.45,0.037500,"APP","00","EXC","5"

[/CODE]

Run the test:
Code:
awk -f translator.awk valdor.txt
0000001111,"IBD","601725","6017257000681563","0430","163458","002820","002820000000","E0107815","1801 3E AVENUE         VAL-D'OR QCCA","0200","","","WD","CH","","4000320275","","124","124",,60.00,60.00,60.00,0.00,0.45,60.45,0.037500,"APP","00","EXC","5"


Last edited by charles_n_may; 05-08-2014 at 06:06 PM.. Reason: removed shell prompt

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #275
Difficulty: Easy
OpenSolaris is the only version of the System V variant of UNIX available as open source.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Replace double quotes inside the string data for all the columns

Please use code tags Hi, I have input data is below format and n of column in the multiple flat files. the string data has any double quotes(") values replaced to double double quotes for all the columns{""). Also, my input flat file each column string data has carriage of new line too.... (14 Replies)
Discussion started by: SSrini
14 Replies

2. Shell Programming and Scripting

Replacing all but the first and last double quote in a line with a single quote with awk

From: 1,2,3,4,5,This is a test 6,7,8,9,0,"This, is a test" 1,9,2,8,3,"This is a ""test""" 4,7,3,1,8,"""" To: 1,2,3,4,5,This is a test 6,7,8,9,0,"This; is a test" 1,9,2,8,3,"This is a ''test''" 4,7,3,1,8,"''"Is there an easy syntax I'm overlooking? There will always be an odd number... (5 Replies)
Discussion started by: Michael Stora
5 Replies

3. Shell Programming and Scripting

Replace Double quotes within double quotes in a column with space while loading a CSV file

Hi All, I'm unable to load the data using sql loader where there are double quotes within the double quotes As these are optionally enclosed by double quotes. Sample Data : "221100",138.00,"D","0019/1477","44012075","49938","49938/15043000","Television - 22" Refurbished - Airwave","Supply... (6 Replies)
Discussion started by: mlavanya
6 Replies

4. Shell Programming and Scripting

sed command to replace string that contain blackslash,double quotes

Hi All, I have been trying to replace a string using the sed command string value contain blackslash and double quotes. I am not a expert writer of unix script but do try not to ask question. I have almost given up. Hope you all can give me some suggestion I want to replace a place string... (6 Replies)
Discussion started by: thanush9sep
6 Replies

5. Shell Programming and Scripting

Issue with Single Quotes and Double Quotes for prompt PS1

Hi, Trying to change the prompt. I have the following code. export PS1=' <${USER}@`hostname -s`>$ ' The hostname is not displayed <abc@`hostname -s`>$ uname -a AIX xyz 1 6 00F736154C00 <adcwl4h@`hostname -s`>$ If I use double quotes, then the hostname is printed properly but... (3 Replies)
Discussion started by: bobbygsk
3 Replies

6. Shell Programming and Scripting

Replace double double quotes using AWK/SED

Hi, I have data as "01/22/97-"aaaaaaaaaaaaaaaaa""aaa""aabbbbbbbbcccccc""zbcd""dddddddddeeeeeeeeefffffff" I want to remove only the Consequitive double quotes and not the one which occurs single. My O/P must be ... (2 Replies)
Discussion started by: Bhuvaneswari
2 Replies

7. Shell Programming and Scripting

Replace single quote with two single quotes in perl

Hi I want to replace single quote with two single quotes in a perl string. If the string is <It's Simpson's book> It should become <It''s Simpson''s book> (3 Replies)
Discussion started by: DushyantG
3 Replies

8. Shell Programming and Scripting

Regex in grep to match all lines ending with a double quote (") OR a single quote (')

Hi, I've been trying to write a regex to use in egrep (in a shell script) that'll fetch the names of all the files that match a particular pattern. I expect to match the following line in a file: Name = "abc" The regex I'm using to match the same is: egrep -l '(^) *= *" ** *"$' /PATH_TO_SEARCH... (6 Replies)
Discussion started by: NanJ
6 Replies

9. Shell Programming and Scripting

Double quotes or single quotes when using ssh?

I'm not very familiar with the ssh command. When I tried to set a variable and then echo its value on a remote machine via ssh, I found a problem. For example, $ ITSME=itsme $ ssh xxx.xxxx.xxx.xxx "ITSME=itsyou; echo $ITSME" itsme $ ssh xxx.xxxx.xxx.xxx 'ITSME=itsyou; echo $ITSME' itsyou $... (3 Replies)
Discussion started by: password636
3 Replies

10. Shell Programming and Scripting

single or double quote in SED

i m trying the following command but its not working: sed 's/find/\'replace\'/g' myFile but the sed enters into new line # sed 's/find/re\'place/g' myFile > I havn't any idea how to put single quote in my replace string. Your early help woud be appreciated. Thanx (2 Replies)
Discussion started by: asami
2 Replies

Featured Tech Videos