Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Handling embedded double quotes within column data

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Handling embedded double quotes within column data
# 1  
Old 12-16-2014
Handling embedded double quotes within column data
I have a text file where each field is enclosed in double quotes and separated by a comma.
But in certain rows we have embedded double quotes within column data

For e.g

Code:
"""TRUSPICE CENTRE""        CLAYTON      AU"

The above value is for a single column but there are embedded quotes within it - which is - ""TRUSPICE CENTRE""
How do I handle this?

I need to remove such embedded quotes if it is present and retain the enclosed quotes.

So the output I need is:

Code:
"TRUSPICE CENTRE        CLAYTON      AU"

Last edited by Don Cragun; 12-16-2014 at 03:25 AM.. Reason: Add CODE and ICODE tags.
# 2  
Old 12-16-2014
Quote:
Originally Posted by abhilashnair
I have a text file where each field is enclosed in double quotes and separated by a comma.
But in certain rows we have embedded double quotes within column data
For e.g
"""TRUSPICE CENTRE"" CLAYTON AU"
The above value is for a single column but there are embedded quotes within it - which is - ""TRUSPICE CENTRE""
How do I handle this?
I need to remove such embedded quotes if it is present and retain the enclosed quotes.
So the output I need is:
"TRUSPICE CENTRE CLAYTON AU"
Hello abhilashnair,

Please use code tags for commands/codes you are using in your posts. Please refer the forum rules in following link.
https://www.unix.com/misc.php?do=cfrules

Following code may help you in same.
Code:
awk '{gsub(/\"\"/,X,$0);print}' Input_file

Output will be as follows.
Code:
"TRUSPICE CENTRE CLAYTON AU"

EDIT: Adding a solution with sed also.
Code:
sed 's/\"\{2\}//g'  Input_file


Thanks,
R. Singh
Last edited by RavinderSingh13; 12-16-2014 at 03:11 AM.. Reason: Added one more solution
# 3  
Old 12-16-2014
Or, since there is nothing special about double quotes in an RE and double quotes don't need to be escaped inside single quotes:
Code:
sed 's/""//g' file

or:
Code:
awk '{gsub(/""/, X, $0);print} file

or even:
Code:
awk 'gsub(/""/, "")+1' file

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Replace double quotes inside the string data for all the columns

Please use code tags Hi, I have input data is below format and n of column in the multiple flat files. the string data has any double quotes(") values replaced to double double quotes for all the columns{""). Also, my input flat file each column string data has carriage of new line too.... (14 Replies)
Discussion started by: SSrini
14 Replies

2. Shell Programming and Scripting

Need shell script to append double quotes for each column in a file

Hi Experts, I am beginner to the shell scripting, My requirement is to append double quotes for each column in a file if double quotes does not exist. Example: "abc"|123|"gh-ch"|23.067 Use code tags, thanks. (10 Replies)
Discussion started by: spidy
10 Replies

3. Shell Programming and Scripting

Replace Double quotes within double quotes in a column with space while loading a CSV file

Hi All, I'm unable to load the data using sql loader where there are double quotes within the double quotes As these are optionally enclosed by double quotes. Sample Data : "221100",138.00,"D","0019/1477","44012075","49938","49938/15043000","Television - 22" Refurbished - Airwave","Supply... (6 Replies)
Discussion started by: mlavanya
6 Replies

4. Shell Programming and Scripting

Skip the delimiter with in double quotes and count the number of delimiters during data extract

Hi All, I'm stuck-up in finding a way to skip the delimiter which come within double quotes using awk or any other better option. can someone please help me out. Below are the details: Delimited: | Sample data: 742433154|"SYN|THESIS MED CHEM PTY.... (2 Replies)
Discussion started by: BrahmaNaiduA
2 Replies

5. Shell Programming and Scripting

Extracting data from between double quotes

Need assistance , Below is the data between double code . </td><td><a href="geavg.t00z.pgrb2af18">geavg.t00z.pgrb2af18</a> Below commands gives me the result but i want everything in one command using single nawk nawk -v RS="< href" -F">" '/t00z/ { print $1 }' ucar.output | nawk -F... (10 Replies)
Discussion started by: ajayram_arya
10 Replies

6. Shell Programming and Scripting

Issue with Single Quotes and Double Quotes for prompt PS1

Hi, Trying to change the prompt. I have the following code. export PS1=' <${USER}@`hostname -s`>$ ' The hostname is not displayed <abc@`hostname -s`>$ uname -a AIX xyz 1 6 00F736154C00 <adcwl4h@`hostname -s`>$ If I use double quotes, then the hostname is printed properly but... (3 Replies)
Discussion started by: bobbygsk
3 Replies

7. Shell Programming and Scripting

Extract data based on 2nd colume having double quotes

i want extract where the 2nd column having "3" or "7". Based on the forums tried like this but it is not working awk -F"," '$2=3;$2=7 {print}' filename Source "1","2","3","4" "1","3","3","4" "1","7","3","4" "1","8","3","4" "1","2","3","4" "1","2","3","4" Output : ... (5 Replies)
Discussion started by: onesuri
5 Replies

8. Shell Programming and Scripting

Double quotes or single quotes when using ssh?

I'm not very familiar with the ssh command. When I tried to set a variable and then echo its value on a remote machine via ssh, I found a problem. For example, $ ITSME=itsme $ ssh xxx.xxxx.xxx.xxx "ITSME=itsyou; echo $ITSME" itsme $ ssh xxx.xxxx.xxx.xxx 'ITSME=itsyou; echo $ITSME' itsyou $... (3 Replies)
Discussion started by: password636
3 Replies

9. Shell Programming and Scripting

comparing scalars contaning "DOUBLE QUOTES" as data

Hello to all, Does anyone know the solution ? Two strings A and B are present. I want to check whether B is a Substring of A. 1. The value of A is - 29 * * * /bin/ls "test" "tmp*" "log*" (Note: Pl note that A contains DOUBLEQUOTES, ASTERISK & FRONTSLASH) 2. The value of B is -... (5 Replies)
Discussion started by: rssrik
5 Replies

10. Shell Programming and Scripting

put double quotes for a column

Hi, I have a file which looks like this, I have stripped most of the columns: 2006,UCA,"02452","NM","1","M","84",123,aa 2006,UCA,"02452","NM","1","L","84",123,bb 2006,UCA,"02452","NM","1","L","84",432,cc 2006,UCA,"02452","NM","1","L","33",213,dd 2006,UCA,"02452","NM","1","L","33",124,ee... (3 Replies)
Discussion started by: sumeet
3 Replies
Login or Register to Ask a Question