01-11-2012
Remove two delimiters, space and double quotes
I would like to know how to replace a space delimiter with a ^_ (\037) delimiter and a double quote delimiter while maintaining the spaces inside the double quotes. The double quote delimiter is only used on text fields.
I'd prefer a one-liner, but could handle a function or script that accepts the filename and delimiter as arguments
I have a txt file that looks like this:
"#04274DV1!" 414 "104274DV1" 04/30/09 1.25 "BRK CD 104274DV1" "BROKERED CD 1.25 04/30/2009" "RAVE BANK $2,590,000.00" "" ? 01/30/09 0 "t" "n" 0 "" ? 0 ? ? "mo" 30 "h"
and I want it to look like (:
#04274DV1!^_414^_104274DV1^_04/30/09^_1.25^_BRK CD 104274DV1^_BROKERED CD 1.25 04/30/2009^_RAVE BANK $2,590,000.00^_^_?^_01/30/09^_0^_t^_n^_0^_^_?^_0^_?^_?^_mo^_30^_h
Last edited by SteveDWin; 01-11-2012 at 09:38 AM..
Reason: code tags
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
A Triva question.
What is the easy way to remove the double quotes in the file in the following format.
"asdfa","fdgh","qwer"
tr -d '\"' <filename >newfilename
mv newfilename oldfilename
This need to be handled in a script. Any better way to do this. Will sed be more effecient?
One... (3 Replies)
Discussion started by: deepakwins
3 Replies
2. UNIX for Advanced & Expert Users
I want to remove the comma which is present within the double quoted string. All other commas which is present outside double quotes should be present.
Input : a,b,"cc,dd,ee",f,ii,"jj,kk",mmm
output : a,b,"ccddee",f,ii,"jjkk",mmm (3 Replies)
Discussion started by: mohan_tuty
3 Replies
3. Shell Programming and Scripting
Hi Unix Gurus..
I am new to Unix. Please help me. The file I am getting is as follows:
Input File
"2011-07-06 03:53:23","0","I","NOT SET ",,,,"123985","SAW CUT CONCRETE SLAB 20"THICK",,"98.57","","EACH","N"
"2011-07-06 03:53:23","0","I","NOT SET ",,,,"204312","ARMAFLEX-1 3/8 X... (2 Replies)
Discussion started by: BICC
2 Replies
4. Shell Programming and Scripting
Hi Guys,
I have a file with content as below
aj.txt
"Iam
allfine" abcdef
abcd "all is
not well"
What I'm trying to say is my data has some new line characters in between quoted text. I must get ride of the newline character that comes in between the quoted text.
output must be:... (8 Replies)
Discussion started by: ajahuja
8 Replies
5. Shell Programming and Scripting
Hi,
I am little new to forum and new on unix side. I have a small issue below:
I am reading a file that has 5 columns something like below.
col1,col2,col3,col4,col5
Some records are having double quoted values something like below:
"value1","value2","value3","value4","value5"
I need... (8 Replies)
Discussion started by: Saanvi1
8 Replies
6. Shell Programming and Scripting
Hi All,
I'm stuck-up in finding a way to skip the delimiter which come within double quotes using awk or any other better option. can someone please help me out.
Below are the details:
Delimited: |
Sample data: 742433154|"SYN|THESIS MED CHEM PTY.... (2 Replies)
Discussion started by: BrahmaNaiduA
2 Replies
7. Shell Programming and Scripting
Hi All,
I'm unable to load the data using sql loader where there are double quotes within the double quotes As these are optionally enclosed by double quotes.
Sample Data :
"221100",138.00,"D","0019/1477","44012075","49938","49938/15043000","Television - 22" Refurbished - Airwave","Supply... (6 Replies)
Discussion started by: mlavanya
6 Replies
8. Shell Programming and Scripting
I have file with are delimited by pipe(|) symbol, I wanted those to be removed except the ones which are enclosed in double quotes.
If your quote file is:
|Life is |Beautiful"|"Indeed life |is beautiful too|"|"But unix is fun| is not"|"
It should return:
Life is Beautiful"|"Indeed life is... (9 Replies)
Discussion started by: Sathyapts
9 Replies
9. Shell Programming and Scripting
How to remove Carriage Return (CRLF) within double quotes in a file. There are multiple CRLFs within double quotes. We are on Ubuntu 14.04.2 LTS.
The file that we are importing is a csv file from unix to windows and the file was formatted to unix2dos. Therefore all lines in the file all have... (12 Replies)
Discussion started by: covina
12 Replies
10. UNIX for Beginners Questions & Answers
Hi,
I've a requirement like, in a csv file of 30+ fields where all the columns are having double quotes I need to remove the double quotes from certain fields and certain field should remain as it is.
Eg:... (6 Replies)
Discussion started by: Krishnanth S
6 Replies
LEARN ABOUT MOJAVE
regexp::common::delimited
Regexp::Common::delimited(3) User Contributed Perl Documentation Regexp::Common::delimited(3)
NAME
Regexp::Common::delimited -- provides a regex for delimited strings
SYNOPSIS
use Regexp::Common qw /delimited/;
while (<>) {
/$RE{delimited}{-delim=>'"'}/ and print 'a " delimited string';
/$RE{delimited}{-delim=>'/'}/ and print 'a / delimited string';
}
DESCRIPTION
Please consult the manual of Regexp::Common for a general description of the works of this interface.
Do not use this module directly, but load it via Regexp::Common.
$RE{delimited}{-delim}{-esc}
Returns a pattern that matches a single-character-delimited substring, with optional internal escaping of the delimiter.
When "-delim=S" is specified, each character in the sequence S is a possible delimiter. There is no default delimiter, so this flag must
always be specified.
If "-esc=S" is specified, each character in the sequence S is the delimiter for the corresponding character in the "-delim=S" list. The
default escape is backslash.
For example:
$RE{delimited}{-delim=>'"'} # match "a " delimited string"
$RE{delimited}{-delim=>'"'}{-esc=>'"'} # match "a "" delimited string"
$RE{delimited}{-delim=>'/'} # match /a / delimited string/
$RE{delimited}{-delim=>q{'"}} # match "string" or 'string'
Under "-keep" (See Regexp::Common):
$1 captures the entire match
$2 captures the opening delimiter (provided only one delimiter was specified)
$3 captures delimited portion of the string (provided only one delimiter was specified)
$4 captures the closing delimiter (provided only one delimiter was specified)
$RE{quoted}{-esc}
A synonym for $RE{delimited}{q{-delim='"`}{...}}
SEE ALSO
Regexp::Common for a general description of how to use this interface.
AUTHOR
Damian Conway (damian@conway.org)
MAINTAINANCE
This package is maintained by Abigail (regexp-common@abigail.be).
BUGS AND IRRITATIONS
Bound to be plenty.
For a start, there are many common regexes missing. Send them in to regexp-common@abigail.be.
LICENSE and COPYRIGHT
This software is Copyright (c) 2001 - 2009, Damian Conway and Abigail.
This module is free software, and maybe used under any of the following licenses:
1) The Perl Artistic License. See the file COPYRIGHT.AL.
2) The Perl Artistic License 2.0. See the file COPYRIGHT.AL2.
3) The BSD Licence. See the file COPYRIGHT.BSD.
4) The MIT Licence. See the file COPYRIGHT.MIT.
perl v5.18.2 2013-03-08 Regexp::Common::delimited(3)