03-03-2009
Merge files of differrent size with one field common in both files using awk
hi,
i am facing a problem in merging two files using awk,
the problem is as stated below,
file1:
A|B|C|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|DD|EE|FF|GG|HH|II|1
....
....
....
file2 :
1|Mn|op|qr
result file
A|B|C|Mn|op|qr|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|Mn|op|qr||DD|EE|FF|GG|HH|II|1
file1 can have more than 10,000 records
file2 can have only 1000 records,
The field's 2,3,4 from second file (file2) should be read and should be inserted into filed's 4,5,6 in first file (file1) where lastfiled of "ile1 == first field of file2"
please give me the solution.......
Thanks
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Please help, I am new to shell Programming. I have three files each containg a unique text (key) field (e.g. ABCDEF, XCDUD as shown below), line return followed by some data of which there can be more then one instance. In addition, in some cases there may be no data but only a key field. Please... (18 Replies)
Discussion started by: gugs
18 Replies
2. Shell Programming and Scripting
I have two files like
File1 : will get this file from "who" command. It is a unix file.
user val1 Jul 29 13:15 (IP Address1)
user val3 Jul 30 03:21 (IP Address2)
user val2 Jul 29 13:16 (IP Address3)
user val4 Jul 29 13:17 (IP Address4)
... (4 Replies)
Discussion started by: manneni prakash
4 Replies
3. Shell Programming and Scripting
I have two text files.
text file 1:
ID filePath col1 col2 col3
1 10584588.mol 269.126 190.958 23.237
2 10584549.mol 281.001 200.889 27.7414
3 10584511.mol 408.824 158.316 29.8561
4 10584499.mol 245.632 153.241 25.2815
5 10584459.mol ... (8 Replies)
Discussion started by: LMHmedchem
8 Replies
4. Shell Programming and Scripting
Hi experts,
Would you please help me with this?
I have several files and I need to join the forth field of them based on the common first field.
here's an example...
first file:
280346 39.88 -75.08 547.8
280690 39.23 -74.83 538.7
280729 40.83 -75.08 499.2
280907 40.9 -74.4 507.8... (5 Replies)
Discussion started by: GoldenFire
5 Replies
5. UNIX for Dummies Questions & Answers
I have 100 data files labelled 250.1.txt through 250.100.txt. The second column of the data files partially match (there is about %90 overlap). Each data file has 4 columns.
I want the merge all these text files by the matching values in the second column. In the output, the first column should... (1 Reply)
Discussion started by: evelibertine
1 Replies
6. UNIX for Dummies Questions & Answers
Hi,
I have two files that I would like to merge and think that there should be a solution using awk. The files look something like this:
file 1
IDX1 IDY1
IDX2 IDY2
IDX3 IDY3
file 2
IDY1 dataA data1
IDY2 dataB data2
IDY3 dataC data3
Desired output
IDX1 IDY1 dataA data1
IDX2 ... (5 Replies)
Discussion started by: katie8856
5 Replies
7. Shell Programming and Scripting
Hi,
I have two files A (2190 rows) and file B (1100 rows). I want to merge the contents of two files based on common field, also I need the unmatched rows from file A
file A:
ABC
XYZ
PQR
file B:
>LMN|chr1:11000-12456:
>ABC|chr15:176578-187678:
>PQR|chr3:14567-15866:
output... (3 Replies)
Discussion started by: Diya123
3 Replies
8. Shell Programming and Scripting
Hi all,
Say i have multiple files x1 x2 x3 x4, all with common header (date, time, year, age),,
How can I merge them to one singe file "X" in shell scripting
Thanks for your suggestions. (2 Replies)
Discussion started by: msarguru
2 Replies
9. UNIX for Dummies Questions & Answers
Hi, I am trying to selectively merge two files based on keys reported in the 1st column.
File1:
#file1-header1
file1-header2
111 qwe rtz uio
198 asd fgh jkl
165 yxc
789 poi uzt rew
89 lkj
File2:
#file2-header2
file2-header2
165 ghz nko2 ... (2 Replies)
Discussion started by: dovah
2 Replies
10. UNIX for Beginners Questions & Answers
Hi,
A beginner one.
my input.tab (tab-separated):
h1 h2 h3 h4 h5
item1 grpA 2 3 customer1
item2 grpB 4 6 customer1
item3 grpA 5 9 customer1
item4 grpA 0 0 customer2
item5 grpA 9 1 customer2
objective:
output a file for each customer ($5) with the item number ($1) only if $2 matches... (2 Replies)
Discussion started by: beca123456
2 Replies
usync(8) System Manager's Manual usync(8)
NAME
usync - synchronize two setld inventory files to reflect current system status
SYNOPSIS
/usr/lbin/usync [-d] file1 file2
OPTIONS
Enables debugging. This will print the pairs of pathnames being synchronized on the standard output.
DESCRIPTION
The usync command is used to achieve inventory synchronization by merging two inventory files according to the pathname field of the inven-
tory records. The result is directed to standard output.
If the two inventory files contain records with the same pathname, the record in file2 is written and the record in file1 is ignored. If
either inventory file contains a pathname not present in the other file, the record containing that pathname is written to standard output.
To reflect the current system inventory, file2 should represent a later installation than file1.
RESTRICTIONS
The two inventory files must be sorted in ascending ASCII sequence on the pathname field.
ERRORS
usync: file is corrupt
Explanation:
Records in one of the inventory files are not sorted properly.
EXAMPLES
The following command produces a synchronized inventory for two versions of the OATDCB subset: /usr/lbin/usync OATDCB100.inv OATDCB120.inv
FILES
Subset inventory files
SEE ALSO
stl_inv(4)
Programming Support Tools
usync(8)