09-13-2016
So we are initially told that we have three CSV input files with semicolons as the field delimiters, but now you are telling us that code RudiC suggested meeting those requirements does not work when one of the input files starts using spaces instead of semicolons as the field delimiters (even though some of the fields in that file contain spaces as data) and one of the input files starts using commas instead of semicolons as the field delimiter. And, instead of seven input fields we now have 10 input fields and we aren't supposed to look at two of those fields because they are messed up.
If your input data formats keep changing, it is not our job to act as your unpaid programming staff and rewrite code to meet your constantly changing input file formats.
If you would like to try modifying RudiC's suggestions to meet your new input file formats, can show us clear specifications for your new input file formats, and can explain where you are stuck trying to get your modifications to work correctly; we will be happy to help you.
If you would like us to guess at what your new input file format is for your third input file and guess at how we might modify RudiC's code to work with your new input file formats, I doubt that many of the volunteers reading your posts here will be interested in tackling that assignment.
This User Gave Thanks to Don Cragun For This Post:
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
I need a little help as I am a complete novice at scripting in unix. However, i am posed with an issue... i have two csv files in the following format@
FILE1.CSV:
HEADER
HEADER
Header
, , HEADER
001X ,,200
002X ,,300
003X ,,300
004X ,,300
FILE2.CSV:
HEADER
HEADER
Header
, ,... (3 Replies)
Discussion started by: chachabronson
3 Replies
2. UNIX for Dummies Questions & Answers
I need a script (perl or awk..anything is fine) to join 3 files based on three key columns. The no of non-key columns can vary in each file. The columns are delimited by semicolon.
For example,
File1
Dim1;Dim2;Dim3;Fact1;Fact2;Fact3;Fact4;Fact5
---- data delimited by semicolon ---
... (1 Reply)
Discussion started by: Sebben
1 Replies
3. Shell Programming and Scripting
Hello, I know how to join multiple files using the cat function. I want to do something a little more advanced. Basically I want to put the filename in the first column...
One thing to note is that the file is tab delimited.
e.g.
file1.txt
joe 1 4 5 6 7 3
manny 2 3 4 5 6 7
... (4 Replies)
Discussion started by: phil_heath
4 Replies
4. UNIX for Dummies Questions & Answers
Hi guys,
I am a forum (and a bit of a unix) newbie, and I currently have a tricky problem lying ahead of me. I have multiple files, and I am looking to join the files on the first column.
Example:
File 1
andy b 100
amy c 200
amy d 300
File 2
andy c 200
amy c 100
clyde o 50
... (3 Replies)
Discussion started by: jdr0317
3 Replies
5. Shell Programming and Scripting
I am trying to execute the following command to check the existance of a file (which has a date timestamp on it). If there are more than one file, then also it should give me 'success' result.
if
then
<do some work>
else
<no files>
fi
Since there are more than one... (18 Replies)
Discussion started by: vivek_damodaran
18 Replies
6. Shell Programming and Scripting
Hi,
I have nine files looking similar to file1 & file2 below.
File1:
1 ABCA1
1 ABCC8
1 ABR:N
1 ACACB
1 ACAP2
1 ACOT1
1 ACSBG
1 ACTR1
1 ACTRT
1 ADAMT
1 AEN:N
1 AKAP1File2:
1 A4GAL
1 ACTBL
1 ACTL7 (4 Replies)
Discussion started by: seqbiologist
4 Replies
7. Shell Programming and Scripting
Hi! I need to learn that how a shell script can transverse a csv file n check if any field is empty or not. means its contains two comma or space b/w commas i.e., "" or " ".
can anyone help me out how I can do that.... (10 Replies)
Discussion started by: sukhdip
10 Replies
8. Shell Programming and Scripting
Hi again,
I have monthly one-column files of roughly around 10 years. Is there a more efficient way to concatenate these files column-wise other than using paste command? For instance:
file1.txt
12
13
15
12
file2.txt
14
15
18
19
file3.txt
20
21 (8 Replies)
Discussion started by: ida1215
8 Replies
9. UNIX for Dummies Questions & Answers
Hello again,
I am trying to join 3rd column of 3 files into the end on one file and save it separately... my data looks like this
file 1
Bob, Green, 80
Mark, Brown, 70
Tina, Smith, 60
file 2
Bob, Green, 70
Mark, Brown, 60
Tina, Smith, 50
file 3
Bob, Green, 50
Mark, Brown,60
Tina,... (6 Replies)
Discussion started by: A-V
6 Replies
10. UNIX for Beginners Questions & Answers
Hello All,
just wanted to export multiple tables from oracle sql using unix shell script to csv file and the below code is exporting only the first table.
Can you please suggest why? or any better idea?
export FILE="/abc/autom/file/geo_JOB.csv"
Export= `sqlplus -s dev01/password@dEV3... (16 Replies)
Discussion started by: Hope
16 Replies
UNIQ(1) BSD General Commands Manual UNIQ(1)
NAME
uniq -- report or filter out repeated lines in a file
SYNOPSIS
uniq [-cdu] [-f fields] [-s chars] [input_file [output_file]]
DESCRIPTION
The uniq utility reads the standard input comparing adjacent lines, and writes a copy of each unique input line to the standard output. The
second and succeeding copies of identical adjacent input lines are not written. Repeated lines in the input will not be detected if they are
not adjacent, so it may be necessary to sort the files first.
The following options are available:
-c Precede each output line with the count of the number of times the line occurred in the input, followed by a single space.
-d Don't output lines that are not repeated in the input.
-f fields
Ignore the first fields in each input line when doing comparisons. A field is a string of non-blank characters separated from adja-
cent fields by blanks. Field numbers are one based, i.e. the first field is field one.
-s chars
Ignore the first chars characters in each input line when doing comparisons. If specified in conjunction with the -f option, the
first chars characters after the first fields fields will be ignored. Character numbers are one based, i.e. the first character is
character one.
-u Don't output lines that are repeated in the input.
If additional arguments are specified on the command line, the first such argument is used as the name of an input file, the second is used
as the name of an output file.
The uniq utility exits 0 on success, and >0 if an error occurs.
COMPATIBILITY
The historic +number and -number options have been deprecated but are still supported in this implementation.
SEE ALSO
sort(1)
STANDARDS
The uniq utility is expected to be IEEE Std 1003.2 (``POSIX.2'') compatible.
BSD
January 6, 2007 BSD