04-24-2010
Need help with unconventional comparing of CSV
Hi All,
Am a newbie at unix, need help for writing a script for comparing two files (csv)and generating two output files (csv)
output1: records from file 1 not found in file 2
output2: records from file 2 not found in file 1 + records from file 2 whose instances (based on column 1) are not equal to instances in file 1
for ex:
file 1
1,1
1,2
2,3
3,3
file 2
1,1
2,3
4,3
output should be
output1:
1,2
3,3
output2:
1,1
4,3
can anyone help???
thanks in advance
-vikaas
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi All,
I've two .csv files as below
file1.csv
abc, tdf, 223, tpx
jgsd, tex, 342, rpy
a, jdjdsd, 423, djfkld
Where as file2.csv is the new version of file1.csv with some added fields in the end of each line and some additional lines.
lfj, eru, 98, jkldj, 39, jdkj9
abc, tdf, 223, tpx,... (3 Replies)
Discussion started by: ganapati
3 Replies
2. Shell Programming and Scripting
Hi there,
I have an csv file.
I want to compare the 16th and 18th columns. They contain alpha numeric characters. Some are same and some are different. We have to pick the ones which are different. But with certain rules.
16th col. 18th col.
---------- ... (1 Reply)
Discussion started by: sickboy
1 Replies
3. Shell Programming and Scripting
Hello,
I have the following problem:
There are two csv files
csv-file #1:
aaa1, aaa2, ... aaan
aaa1, bbb2, ... bbbn
aaa1, ccc2, ... cccn
bbb1, bbb2, ... bbbn
...
zzz1, zzz2, ... zzzn
csv-file #2:
aaa1, matchvalue1
ccc1, matchvalue2 (7 Replies)
Discussion started by: ghl10000
7 Replies
4. Shell Programming and Scripting
EDIT: My problems have been solved thanks to the help of bartus11 and pravin27
This code is just to help me learn. It serves no purpose other than that.
Here's a sample csv that I'm working with -
#listofpeeps.csv
Jackie Chan,1954,M
Chuck Norris,1930,M
Bruce Lee,1940,M
This code is... (13 Replies)
Discussion started by: chickeneaterguy
13 Replies
5. Shell Programming and Scripting
Hi!
I'm just new to shell scripting n simple tasks looks so tough in initial stage. i need to write a script which will read a property file, property file will be containing count of the csv files, and in a folder(same folder) there will be respective csv files.
like Property file
data1=100... (3 Replies)
Discussion started by: sukhdip
3 Replies
6. Shell Programming and Scripting
Hello,
I have about 10 csv files which range from csv1 - csv10.
Each csv file has same type/set of tabs and we have around 5-6 tabs for each of the csv file which have slightly different content(data).
A sample of CSV1 is shown below:
Joins: Data related to Joins, it can be any number of... (2 Replies)
Discussion started by: bobby1015
2 Replies
7. Shell Programming and Scripting
(say) I have 2 csv files - file1.csv & file2.csv as mentioned below:
file1.csv
ID,version,cost
1000,1,30
2000,2,40
3000,3,50
4000,4,60
file2.csv
ID,version,cost
1000,1,30
2000,2,45
3000,4,55
6000,5,70
... (1 Reply)
Discussion started by: Naresh101
1 Replies
8. Shell Programming and Scripting
Hi All,
My requirement is to write a shell script to compare two large csv files.
I've created sample files for explaining my problem
i.e., a.csv and b.csv
contents of files:
-----------------
a.csv
------
Type,Memory (Kb),Location HD,Size (Mb),Serial #
XT,640,D402,0,MG0010... (2 Replies)
Discussion started by: vasavi
2 Replies
9. Shell Programming and Scripting
I have two csv files and im trying to compare them. e.g.
SAMPLE DATA:
file one:
ZipCode Name
20878 Washington
10023 Missouri
20304 Maryland
file two:
ID Name City ZipCode
11654 ... (11 Replies)
Discussion started by: dan139
11 Replies
10. UNIX for Beginners Questions & Answers
Hello all,
I have searched high and low for a solution to this, many have come really close but not quite what I'm after.
I have 2 files. One contains GUID's, for example:
8121E002-96FE-4C9C-BC5A-6AFF20DACECD
84468F30-F3B7-418B-81F0-0908E80792BF
A second file, contains a path to the... (8 Replies)
Discussion started by: tirmUK
8 Replies
RLAM(1) General Commands Manual RLAM(1)
NAME
rlam - laminate records from multiple files
SYNOPSIS
rlam [ -tS ][ -u ][ -iaN | -ifN | -idN | -iiN | -iwN | -ibN ] input1 input2 ..
DESCRIPTION
Rlam simply joins records (or lines) from multiple inputs, separating them with the given string (TAB by default). Different separators
may be given for different files by specifying additional -t options in between each file name. Note that there is no space between this
option and its argument. If none of the input files uses an ASCII separator, then no end-of-line character will be printed, either.
An input is either a stream or a command. Commands are given in quotes, and begin with an exclamantion point ('!'). If the inputs do not
have the same number of lines, then shorter files will stop contributing to the output as they run out.
The -ia option may be used to specify ASCII input (the default), or the -if option may be used to indicated binary IEEE 32-bit floats on
input. Similarly, the -id and -ii options may be used to indicate binary 64-bit doubles or integer words, respectively. The -iw option
specifies 2-byte short words, and the -ib option specifies bytes. If a number is immediately follows any of these options, then it indi-
cates that multiple such values are expected for each record. For example, -if3 indicates three floats per input record for the next named
input. In the case of the -ia option, no number indicates one line per input record, and numbers greater than zero indicate that many
characters exactly per record. For binary input formts, no number implies one value per record. For anything other than EOL-separated
input, the default tab separator is reset to the empty string.
A hyphen ('-') by itself can be used to indicate the standard input, and may appear multiple times. The -u option forces output after each
record (i.e., one run through inputs).
EXAMPLE
To join files output1 and output2, separated by a comma:
rlam -t, output1 output2
To join a file with line numbers (starting at 0) and its reverse:
cnt `wc -l < lam.c` | rlam - -t: lam.c -t '!tail -r lam.c'
To join four data files, each having three doubles per record:
rlam -id3 file1.dbl file2.dbl file3.dbl file4.dbl > combined.dbl
AUTHOR
Greg Ward
SEE ALSO
cnt(1), histo(1), neaten(1), rcalc(1), tabfunc(1), total(1)
RADIANCE
7/8/97 RLAM(1)