03-03-2009
Merge files of differrent size with one field common in both files using awk
hi,
i am facing a problem in merging two files using awk,
the problem is as stated below,
file1:
A|B|C|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|DD|EE|FF|GG|HH|II|1
....
....
....
file2 :
1|Mn|op|qr
result file
A|B|C|Mn|op|qr|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|Mn|op|qr||DD|EE|FF|GG|HH|II|1
file1 can have more than 10,000 records
file2 can have only 1000 records,
The field's 2,3,4 from second file (file2) should be read and should be inserted into filed's 4,5,6 in first file (file1) where lastfiled of "ile1 == first field of file2"
please give me the solution.......
Thanks
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Please help, I am new to shell Programming. I have three files each containg a unique text (key) field (e.g. ABCDEF, XCDUD as shown below), line return followed by some data of which there can be more then one instance. In addition, in some cases there may be no data but only a key field. Please... (18 Replies)
Discussion started by: gugs
18 Replies
2. Shell Programming and Scripting
I have two files like
File1 : will get this file from "who" command. It is a unix file.
user val1 Jul 29 13:15 (IP Address1)
user val3 Jul 30 03:21 (IP Address2)
user val2 Jul 29 13:16 (IP Address3)
user val4 Jul 29 13:17 (IP Address4)
... (4 Replies)
Discussion started by: manneni prakash
4 Replies
3. Shell Programming and Scripting
I have two text files.
text file 1:
ID filePath col1 col2 col3
1 10584588.mol 269.126 190.958 23.237
2 10584549.mol 281.001 200.889 27.7414
3 10584511.mol 408.824 158.316 29.8561
4 10584499.mol 245.632 153.241 25.2815
5 10584459.mol ... (8 Replies)
Discussion started by: LMHmedchem
8 Replies
4. Shell Programming and Scripting
Hi experts,
Would you please help me with this?
I have several files and I need to join the forth field of them based on the common first field.
here's an example...
first file:
280346 39.88 -75.08 547.8
280690 39.23 -74.83 538.7
280729 40.83 -75.08 499.2
280907 40.9 -74.4 507.8... (5 Replies)
Discussion started by: GoldenFire
5 Replies
5. UNIX for Dummies Questions & Answers
I have 100 data files labelled 250.1.txt through 250.100.txt. The second column of the data files partially match (there is about %90 overlap). Each data file has 4 columns.
I want the merge all these text files by the matching values in the second column. In the output, the first column should... (1 Reply)
Discussion started by: evelibertine
1 Replies
6. UNIX for Dummies Questions & Answers
Hi,
I have two files that I would like to merge and think that there should be a solution using awk. The files look something like this:
file 1
IDX1 IDY1
IDX2 IDY2
IDX3 IDY3
file 2
IDY1 dataA data1
IDY2 dataB data2
IDY3 dataC data3
Desired output
IDX1 IDY1 dataA data1
IDX2 ... (5 Replies)
Discussion started by: katie8856
5 Replies
7. Shell Programming and Scripting
Hi,
I have two files A (2190 rows) and file B (1100 rows). I want to merge the contents of two files based on common field, also I need the unmatched rows from file A
file A:
ABC
XYZ
PQR
file B:
>LMN|chr1:11000-12456:
>ABC|chr15:176578-187678:
>PQR|chr3:14567-15866:
output... (3 Replies)
Discussion started by: Diya123
3 Replies
8. Shell Programming and Scripting
Hi all,
Say i have multiple files x1 x2 x3 x4, all with common header (date, time, year, age),,
How can I merge them to one singe file "X" in shell scripting
Thanks for your suggestions. (2 Replies)
Discussion started by: msarguru
2 Replies
9. UNIX for Dummies Questions & Answers
Hi, I am trying to selectively merge two files based on keys reported in the 1st column.
File1:
#file1-header1
file1-header2
111 qwe rtz uio
198 asd fgh jkl
165 yxc
789 poi uzt rew
89 lkj
File2:
#file2-header2
file2-header2
165 ghz nko2 ... (2 Replies)
Discussion started by: dovah
2 Replies
10. UNIX for Beginners Questions & Answers
Hi,
A beginner one.
my input.tab (tab-separated):
h1 h2 h3 h4 h5
item1 grpA 2 3 customer1
item2 grpB 4 6 customer1
item3 grpA 5 9 customer1
item4 grpA 0 0 customer2
item5 grpA 9 1 customer2
objective:
output a file for each customer ($5) with the item number ($1) only if $2 matches... (2 Replies)
Discussion started by: beca123456
2 Replies
LEARN ABOUT DEBIAN
h5diff
h5diff(1) General Commands Manual h5diff(1)
NAME
h5diff - Compares two HDF5 files and reports the differences.
SYNOPSIS
h5diff file1 file2 [OPTIONS] [object1 [object2 ] ]
DESCRIPTION
h5diff is a command line tool that compares two HDF5 files, file1 and file2, and reports the differences between them.
Optionally, h5diff will compare two objects within these files. If only one object, object1, is specified, h5diff will compare object1 in
file1 with object1 in file2. In two objects, object1 and object2, are specified, h5diff will compare object1 in file1 with object2 in
file2. These objects must be HDF5 datasets.
object1 and object2 must be expressed as absolute paths from the respective file's root group.
Additional information, with several sample cases, can be found in the document H5diff Examples.
OPTIONS
file1 file2
The HDF5 files to be compared.
-h Print all differences.
-r Print only the names of objects that differ; do not print the differences. These objects may be HDF5 datasets, groups, or named
datatypes.
-n count
Print difference up to count differences, then stop. count must be a positive integer.
-d delta
Print only differences that are greater than the limit delta. delta must be a positive number. The comparison criterion is whether
the absolute value of the difference of two corresponding values is greater than delta (e.g., |a-b| > delta, where a is a value in
file1 and b is a value in file2).
-p relative
Print only differences that are greater than a relative error. relative must be a positive number. The comparison criterion is
whether the absolute value of the difference 1 and the ratio of two corresponding values is greater than relative (e.g., |1-(b/a)| >
relative where a is a value in file1 and b is a value in file2).
object1 object2
Specific object(s) within the files to be compared.
EXAMPLES
The following h5diff call compares the object /a/b in file1 with the object /a/c in file2:
h5diff file1 file2 /a/b /a/c
This h5diff call compares the object /a/b in file1 with the same object in file2:
h5diff file1 file2 /a/b
And this h5diff call compares all objects in both files:
h5diff file1 file2
SEE ALSO
h5dump(1), h5ls(1), h5repart(1), h5import(1), gif2h5(1), h52gif(1), h5perf(1)
h5diff(1)