12-18-2008
Removing double quotes in a file
Hi All,
I have a tab delimited file where each of the strings have double quotes.
The problem is that I have records which are in the following format:
"TEXAS" ""HOUSTON"" "123" "" "2625-39-39"
""MAINE"" "" "456" "I" "3737-39-82"
I would have to output another tab delimited file in the following fashion with the extra double quotes around the string removed:
"TEXAS" "HOUSTON" "123" "" "2625-39-39"
"MAINE" "" "456" "I" "3737-39-82"
This problem seems to persits across multiple fields and multiple rows.
Thanks for your help!!!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a csv file with lines like the followings
123456,"ABC CO., LTD","XXX"
789012,"DEF LIMITED", "XXX"
before I bcp this file to database, the comma in "CO.," need to be removed first.
My script is cat <filename> | sed 's/"CO.,"/"CO."/g'
but it doesn't work. Can anyone here able to... (2 Replies)
Discussion started by: joanneho
2 Replies
2. Shell Programming and Scripting
The below code is to convert csv file to pipe delimited.
It replaces comma with pipe if it is not in double quotes; If comma is in double quotes it doesnot replace the comma with a pipe.
The code works fine except it eat away the double quotes in the output file.
BEGIN... (6 Replies)
Discussion started by: pinnacle
6 Replies
3. Shell Programming and Scripting
I have a flat file sample like this -
"COURSE"|"ddddd " " dddd"|"sssddd
sdsdsdsdx" dddddddd ffffff
"aaaaa" dddddddd ffffff
sdsdsd"|"xxxxxxx"|
"COURSE"|"ffff " " bbbb"|"lllll"|
The delimiter is pipe character (|) and the text are enclosed in double quotes... (5 Replies)
Discussion started by: vishalzone
5 Replies
4. UNIX for Dummies Questions & Answers
Unix superusers,
I am new to unix but would like to learn more about grep. I am very familiar with regular expressions as i have used them for searching text files in windows based text editors. Since I am not very familiar with Unix, I dont understand when one should use GREP with the... (2 Replies)
Discussion started by: george_vandelet
2 Replies
5. Shell Programming and Scripting
I have one file a.txt as below.
a.txt
"aaas","111111","ewwee32e","deee333",
"aaas","111111","ewwee32e","deee333",
"aaas","111111","ewwee32e","deee333",
"aaas","111111","ewwee32e","deee333",
I want to write a script to process a.txt and want the output as below in different file as below -... (2 Replies)
Discussion started by: ravigupta2u
2 Replies
6. Shell Programming and Scripting
Hi,
Trying to change the prompt. I have the following code.
export PS1='
<${USER}@`hostname -s`>$ '
The hostname is not displayed
<abc@`hostname -s`>$ uname -a
AIX xyz 1 6 00F736154C00
<adcwl4h@`hostname -s`>$
If I use double quotes, then the hostname is printed properly but... (3 Replies)
Discussion started by: bobbygsk
3 Replies
7. Shell Programming and Scripting
Hi All,
I'm unable to load the data using sql loader where there are double quotes within the double quotes As these are optionally enclosed by double quotes.
Sample Data :
"221100",138.00,"D","0019/1477","44012075","49938","49938/15043000","Television - 22" Refurbished - Airwave","Supply... (6 Replies)
Discussion started by: mlavanya
6 Replies
8. Shell Programming and Scripting
Hi I have a .csv file and when opened in notepad looks like this
gggg,nnnn,"last,first","llll""",nnn
So, Here I would like the ouput as below
gggg,nnnn,"last,first","llll",nnn
i.e replace all two double quotes into one. How could I do that?
This file is being processed by another... (5 Replies)
Discussion started by: dnat
5 Replies
9. Shell Programming and Scripting
Hi Experts,
Please support
I have below data in file in comma seperated, but 4th column is containing comma in between numbers, bcz of which when i tried to parse the file the column 6th value(5049641141) is being removed from the file and value(222.82) in column 5 becoming value of column6.
... (3 Replies)
Discussion started by: as7951
3 Replies
10. Shell Programming and Scripting
Hi ALL,
file data like :
test.csv
a,b,"c,d"
my awk version is 4.0.2 ,if i am using the below code is working fine.
awk -vFPAT='(*)|("+")' -vOFS="," '{print $3}' test.csv
if the awk version is 3.1.7 is not working . Could you please help me on this one.
output should be : "c,d" (6 Replies)
Discussion started by: bmk123
6 Replies
LEARN ABOUT REDHAT
encode::alias
Encode::Alias(3pm) Perl Programmers Reference Guide Encode::Alias(3pm)
NAME
Encode::Alias - alias definitions to encodings
SYNOPSIS
use Encode;
use Encode::Alias;
define_alias( newName => ENCODING);
DESCRIPTION
Allows newName to be used as an alias for ENCODING. ENCODING may be either the name of an encoding or an encoding object (as described in
Encode).
Currently newName can be specified in the following ways:
As a simple string.
As a qr// compiled regular expression, e.g.:
define_alias( qr/^iso8859-(d+)$/i => '"iso-8859-$1"' );
In this case, if ENCODING is not a reference, it is "eval"-ed in order to allow $1 etc. to be substituted. The example is one way to
alias names as used in X11 fonts to the MIME names for the iso-8859-* family. Note the double quotes inside the single quotes.
If you are using a regex here, you have to use the quotes as shown or it won't work. Also note that regex handling is tricky even for
the experienced. Use it with caution.
As a code reference, e.g.:
define_alias( sub { return /^iso8859-(d+)$/i ? "iso-8859-$1" : undef } , '');
In this case, $_ will be set to the name that is being looked up and ENCODING is passed to the sub as its first argument. The example
is another way to alias names as used in X11 fonts to the MIME names for the iso-8859-* family.
Alias overloading
You can override predefined aliases by simply applying define_alias(). The new alias is always evaluated first, and when neccessary,
define_alias() flushes the internal cache to make the new definition available.
# redirect SHIFT_JIS to MS/IBM Code Page 932, which is a
# superset of SHIFT_JIS
define_alias( qr/shift.*jis$/i => '"cp932"' );
define_alias( qr/sjis$/i => '"cp932"' );
If you want to zap all predefined aliases, you can use
Encode::Alias->undef_aliases;
to do so. And
Encode::Alias->init_aliases;
gets the factory settings back.
SEE ALSO
Encode, Encode::Supported
perl v5.8.0 2002-06-01 Encode::Alias(3pm)