Combine two Fields if there's a comma between Post: 302969095

Sponsored Content

Top Forums Shell Programming and Scripting Combine two Fields if there's a comma between Post 302969095 by Don Cragun on Friday 18th of March 2016 02:22:31 AM

03-18-2016

Registered User

I am totally confused by the description of your problem. You start off with a file of information extracted from a database into a character separated values file with vertical-bar as the separation character. (In which case commas should be absolutely unimportant.)

Then you say you open it in csv??? What is csv? Is it the name of a utility that you have written that assumes that every comma (and sometimes also a space following a comma) should be changed to a vertical-bar? It sounds like your entire problem is that you are using a utility that destroyed the commas in your input file when you didn't want the commas to be changed at all. Why are you using a utility that destroys your input data?

Then you say that the output that you want should randomly replace vertical-bar characters in your input file with three, four, or five space characters and sometimes remove a single space character following a comma. But the description of your problem didn't say anything about changing vertical-bar characters to random numbers of adjacent space characters.

Then you show us an awk script that surrounds each input field with double-quote characters (not affecting commas and not changing vertical-bar field separation characters).

Please give us a MUCH clearer explanation of what you are trying to do (and use CODE tags when displaying sample input, sample output, AND code segments so we have a chance of telling the difference between a single space character and sequences of multiple adjacent space tab characters).

This User Gave Thanks to Don Cragun For This Post:

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Combine fields and eliminate white space

Good Morning, Newbie here. Could someone help with shell scripting that will enable me to combine 2 fields into one eliminating the white space. The fields are fixed but the data of course varies. For example: First Name: "George " 20 positions" Last Name: "Washington " 30 positions" I need...

2. UNIX for Dummies Questions & Answers

Sort the fields in a comma delimited file

Hi, I have a comma delimited file. I want to sort the fields alphabetically and again store them in a comma delimited file. For example, My file looks like this. abc,aaa,xyz,xxx,def pqr,ggg,eee,iii,qqq zyx,lmo,pqr,abc,fff and I want my output to look like this, all fields sorted...

3. Shell Programming and Scripting

Trimming fields for comma or pipe seperated file

I have file like this FileA: abc , "helloworld" , america def,asia, japan ghi, africa, ipl Output Needed: abc,"helloworld",america def,asia,japan ghi,africa,ipl I would like to implement using awk. I want to trim each field for its leading and trailing spaces.

4. Shell Programming and Scripting

how to combine fields from different files

linus>cat data1 8119463 | 15000 8136789 | 50000 8152238 | 15000 8167890 | 15000 7155789 | 15000 8123334 | 30000 7166330 | 15000 8146683 | 15000 8152238 | 15000 8167877 | 15000 7145389 | 15000 8178434 | 15000 7166222 | 50000 8167566 | 15000 8115410 | 45000...

5. Shell Programming and Scripting

How to combine first,second and third fields in a file

Hi Guys, I have a file as follows: 1 2 3 There are 5 spaces between 1 and 2 and one space between 2 and 3. I want: 123 How can I do this using awk? I tried using:

6. Shell Programming and Scripting

How to combine two files based on fields?

I have two files which are as follows: File 1: 1 abc 250 2 pqr 300 3 xyz 100 File 2: 1 abc 230 2 pqr 700 3 xyz 500 Now I need output File, File 3as: S.No Name Count1 Count2 1 abc 250 230 2 pqr 300 700 3 xyz 100 500 NOTE:

7. Shell Programming and Scripting

Search and combine fields

Hi all, 1. I have a log file 2011/11/14 00:42:50 | 38:guess pid=008499 opened Testing 0, 1, 2, 3 2011/11/14 11:43:42 | 38:guess pid=008499 closed 2011/11/14 11:47:08 | 39:guess pid=017567 opened Testing 0, 1, 2, 3 2011/11/14 11:47:08 | 40:guess pid=012780 opened Testing 0, 1,...

8. Shell Programming and Scripting

Trying to combine fields with sort/join

I have a file with two fields in it delimited by a comma. Some of the first fields are duplicates. I am trying to eliminate any duplicate records in the first field, and combine the second fields in the output file. For example, if the input is: Jane,group=A Bob,group=A Bob,group=D...

9. Shell Programming and Scripting

awk to format file and combine two fields using comma

I am trying to use awk to format the file below, which is tab-delimited. The desired out is space delimited and is in the order of $9 $13 $2 $10-$11.$10 and $11 are often times multiple values separated by a comma, so the value in $10 is combined with the first value from $11 using the comma....

10. UNIX for Beginners Questions & Answers

How to extract fields from a CSV i.e comma separated where some of the fields having comma as value?

can anyone help me!!!! How to I parse the CSV file file name : abc.csv (csv file) The above file containing data like abv,sfs,,hju,',',jkk wff,fst,,rgr,',',rgr ere,edf,erg,',',rgr,rgr I have a requirement like i have to extract different field and assign them into different...

LEARN ABOUT DEBIAN

dpkg-awk

DPKG-AWK(1)						      General Commands Manual						       DPKG-AWK(1)

NAME

       dpkg-awk - Utility to read a dpkg style db file

SYNOPSIS

       dpkg-awk [(-f|--file) filename] [(-d|--debug) ##] [(-s|--sort) list] [(-rs|--rec_sep) ??] '<fieldname>:<regex>' ... -- <out_fieldname> ..

DESCRIPTION

       dpkg-awk  Parses  a  dpkg status file (or other similarly formatted file) and outputs the resulting records.  It can use regex on the field
       values to limit the returned records, it can also be told which fields to output, and it can sort the matched fields.

OPTIONS

       -f filename
       --file filename
	      The file to parse.  The default is /var/lib/dpkg/status.

       -d [#]
       --debug [#]
	      Each time this is specified, it increased the debug level.

       -s field(s)
       --sort field(s)
	      A space or comma separated list of fields to sort on.

       -n field(s)
       --numeric field(s)
	      A space or comma separated list of fields that should be interpreted as numeric in value.

       -rs ??
       --rec_sep ??
	      Output this string at the end of each output paragraph.

       -h
       --help Display some help.

       fieldname
	      The fields from the file, that are matched with the regex given.	The fieldnames are case insensitive.

       out_fieldname
	      The fields from the file, that are output for each record.  If the first field listed begins with ^, then the list  of  fields  that
	      follows will NOT be output.

BUGS

       Be  warned  that  the author has only a shallow understanding of the dpkg packaging system, so there are probably tons of bugs in this pro-
       gram.

       This program comes with no warranties.  If running this program causes fire and brimstone to rain down upon the earth, you will be on  your
       own.

       This program accesses the dpkg database directly in places, querying for data that cannot be gotten via dpkg.

AUTHOR

       Adam Heath <doogie@debian.org>

DEBIAN
								 Debian Utilities						       DPKG-AWK(1)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Combine fields and eliminate white space

Discussion started by: ski

2. UNIX for Dummies Questions & Answers

Sort the fields in a comma delimited file

Discussion started by: swethapatil

3. Shell Programming and Scripting

Trimming fields for comma or pipe seperated file

Discussion started by: pinnacle

4. Shell Programming and Scripting

how to combine fields from different files

Discussion started by: littleb