03-18-2016
I am totally confused by the description of your problem. You start off with a file of information extracted from a database into a character separated values file with vertical-bar as the separation character. (In which case commas should be absolutely unimportant.)
Then you say you open it in csv??? What is csv? Is it the name of a utility that you have written that assumes that every comma (and sometimes also a space following a comma) should be changed to a vertical-bar? It sounds like your entire problem is that you are using a utility that destroyed the commas in your input file when you didn't want the commas to be changed at all. Why are you using a utility that destroys your input data?
Then you say that the output that you want should randomly replace vertical-bar characters in your input file with three, four, or five space characters and sometimes remove a single space character following a comma. But the description of your problem didn't say anything about changing vertical-bar characters to random numbers of adjacent space characters.
Then you show us an awk script that surrounds each input field with double-quote characters (not affecting commas and not changing vertical-bar field separation characters).
Please give us a MUCH clearer explanation of what you are trying to do (and use CODE tags when displaying sample input, sample output, AND code segments so we have a chance of telling the difference between a single space character and sequences of multiple adjacent space tab characters).
This User Gave Thanks to Don Cragun For This Post:
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Good Morning,
Newbie here. Could someone help with shell scripting that will enable me to combine 2 fields into one eliminating the white space. The fields are fixed but the data of course varies.
For example:
First Name: "George " 20 positions"
Last Name: "Washington " 30 positions"
I need... (2 Replies)
Discussion started by: ski
2 Replies
2. UNIX for Dummies Questions & Answers
Hi,
I have a comma delimited file. I want to sort the fields alphabetically and again store them in a comma delimited file.
For example, My file looks like this.
abc,aaa,xyz,xxx,def
pqr,ggg,eee,iii,qqq
zyx,lmo,pqr,abc,fff
and I want my output to look like this, all fields sorted... (3 Replies)
Discussion started by: swethapatil
3 Replies
3. Shell Programming and Scripting
I have file like this
FileA:
abc , "helloworld" , america
def,asia, japan
ghi, africa, ipl
Output Needed:
abc,"helloworld",america
def,asia,japan
ghi,africa,ipl
I would like to implement using awk.
I want to trim each field for its leading and trailing spaces. (7 Replies)
Discussion started by: pinnacle
7 Replies
4. Shell Programming and Scripting
linus>cat data1
8119463 | 15000
8136789 | 50000
8152238 | 15000
8167890 | 15000
7155789 | 15000
8123334 | 30000
7166330 | 15000
8146683 | 15000
8152238 | 15000
8167877 | 15000
7145389 | 15000
8178434 | 15000
7166222 | 50000
8167566 | 15000
8115410 | 45000... (2 Replies)
Discussion started by: littleb
2 Replies
5. Shell Programming and Scripting
Hi Guys,
I have a file as follows:
1 2 3
There are 5 spaces between 1 and 2 and one space between 2 and 3.
I want:
123
How can I do this using awk?
I tried using: (8 Replies)
Discussion started by: npatwardhan
8 Replies
6. Shell Programming and Scripting
I have two files which are as follows:
File 1:
1 abc 250
2 pqr 300
3 xyz 100
File 2:
1 abc 230
2 pqr 700
3 xyz 500
Now I need output File, File 3as:
S.No Name Count1 Count2
1 abc 250 230
2 pqr 300 700
3 xyz 100 500
NOTE: (13 Replies)
Discussion started by: karumudi7
13 Replies
7. Shell Programming and Scripting
Hi all,
1. I have a log file
2011/11/14 00:42:50 | 38:guess pid=008499 opened Testing 0, 1, 2, 3
2011/11/14 11:43:42 | 38:guess pid=008499 closed
2011/11/14 11:47:08 | 39:guess pid=017567 opened Testing 0, 1, 2, 3
2011/11/14 11:47:08 | 40:guess pid=012780 opened Testing 0, 1,... (4 Replies)
Discussion started by: sabercats
4 Replies
8. Shell Programming and Scripting
I have a file with two fields in it delimited by a comma. Some of the first fields are duplicates. I am trying to eliminate any duplicate records in the first field, and combine the second fields in the output file.
For example, if the input is:
Jane,group=A
Bob,group=A
Bob,group=D... (3 Replies)
Discussion started by: DJR
3 Replies
9. Shell Programming and Scripting
I am trying to use awk to format the file below, which is tab-delimited. The desired out is space delimited and is in the order of
$9 $13 $2 $10-$11.$10 and $11 are often times multiple values separated by a comma, so the value in $10 is combined with the first value from
$11 using the comma.... (5 Replies)
Discussion started by: cmccabe
5 Replies
10. UNIX for Beginners Questions & Answers
can anyone help me!!!! How to I parse the CSV file
file name : abc.csv (csv file) The above file containing data like
abv,sfs,,hju,',',jkk wff,fst,,rgr,',',rgr ere,edf,erg,',',rgr,rgr I have a requirement like i have to extract different field and assign them into different... (4 Replies)
Discussion started by: J.Jena
4 Replies
UNIQ(1) BSD General Commands Manual UNIQ(1)
NAME
uniq -- report or filter out repeated lines in a file
SYNOPSIS
uniq [-cdu] [-f fields] [-s chars] [input_file [output_file]]
DESCRIPTION
The uniq utility reads the standard input comparing adjacent lines, and writes a copy of each unique input line to the standard output. The
second and succeeding copies of identical adjacent input lines are not written. Repeated lines in the input will not be detected if they are
not adjacent, so it may be necessary to sort the files first.
The following options are available:
-c Precede each output line with the count of the number of times the line occurred in the input, followed by a single space.
-d Don't output lines that are not repeated in the input.
-f fields
Ignore the first fields in each input line when doing comparisons. A field is a string of non-blank characters separated from adja-
cent fields by blanks. Field numbers are one based, i.e. the first field is field one.
-s chars
Ignore the first chars characters in each input line when doing comparisons. If specified in conjunction with the -f option, the
first chars characters after the first fields fields will be ignored. Character numbers are one based, i.e. the first character is
character one.
-u Don't output lines that are repeated in the input.
If additional arguments are specified on the command line, the first such argument is used as the name of an input file, the second is used
as the name of an output file.
The uniq utility exits 0 on success, and >0 if an error occurs.
COMPATIBILITY
The historic +number and -number options have been deprecated but are still supported in this implementation.
SEE ALSO
sort(1)
STANDARDS
The uniq utility is expected to be IEEE Std 1003.2 (``POSIX.2'') compatible.
BSD
January 6, 2007 BSD