10-06-2008
merge two files using awk
Hi Guys,
I wonder whether is possible to merge two files using awk. I have two files one with 7 columns and another one with 9 columns and the first column on both files is identical so will be my key to merge the files. Any ideas.Thanks in advance.
Harby.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
hi,
i am facing a problem in merging two files using awk,
the problem is as stated below,
file1:
A|B|C|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|DD|EE|FF|GG|HH|II|1
....
....
....
file2 :
1|Mn|op|qr (2 Replies)
Discussion started by: shashi1982
2 Replies
2. Shell Programming and Scripting
Hi, guys. I have one question:
I have two files: passwd and shadow (the number of records in these files are not equal)the contents of them are below:
passwd:
**************
ftp:x:24:24:
sshd:x:71:65:
uucp:x:10:14:
brownj:x:5005:1000:
sherrys: x :5006:1000:
...
*************
... (2 Replies)
Discussion started by: daikeyang
2 Replies
3. Shell Programming and Scripting
Hello,
I'm new to awk. I've 2 files where H stands for header and T for trailer. The number following T gives the record count in a file.
file 1 looks like this:
H|A|B|C
1|2|3
1|2|4
2|3|5
T|3
file 2 looks like this:
H|A|B|C
4|5|6
7|8|9
T|2
Need to merge the above 2 files such... (2 Replies)
Discussion started by: skumre
2 Replies
4. Shell Programming and Scripting
I have 2 files pipe delimted and want to merge them based on a key
e.g file 1
123$aaa$yyy$zzz
345$xab$yzy$zyz
456$sss$ttt$foo
799$aaa$ggg$dee
file 2
123$hhh
345$ddd
456$xxx
888$zzz
so if the key is the first field, and the result should be the common key between file 1 and 2 (6 Replies)
Discussion started by: loloAix
6 Replies
5. Shell Programming and Scripting
I want to merge data from 2nd file to 1st file based on 1st column
File1
====
data1,12,comp1
data1,13,comp2
data3,14,,
File2
====
data1,11,host1,lit
data2,11,host2,lit3
data3,11,host3,lit4
Required Ouput (5 Replies)
Discussion started by: greycells
5 Replies
6. Shell Programming and Scripting
I have two file like follows. I want to merge them according the first field of file1. The separator of file1 is tab, while the second one is ",". I tried some code, but can't get the results.
File1:
AABB 6072 28 5922
BBCC 316 147 162
CCDD 907 71 231
File2:
CCDD,hTRBV12-4,hTRBJ2-3,319895... (7 Replies)
Discussion started by: xshang
7 Replies
7. Shell Programming and Scripting
Dear Awk experts!
I have been trying to get a one liner for a match and merge operation, but having difficulties as I'm an awk newb. I always get stuck on the match and merge with 2 files.
I have 2 files as follows:
File 1:
field 1,field 2,field 3,field 4,field 5,field 6,field 7,field... (6 Replies)
Discussion started by: landossa
6 Replies
8. Shell Programming and Scripting
file1
AAA3:WWW1:DDD1:XXX8:DDD2:XXX9
AAA6:WWW2:FFF1:XXX130:FFF1:XXX104:FFF1:XXX16
AAA7:WWW3:ZZZ1:XXX4:ZZZ2:XXX5:ZZZ3:XXX6:ZZZ4:XXX7file2
XXX8:EEE1:EEE2
XXX9:KKK1:KKK2
XXX130:OOO1:OOO2
XXX104:PPP1:PPP2
XXX16:RRR1:RRR1
XXX4:UUU1:UUU2
XXX5:III1:III2
XXX7:JJJ1:JJJ2Result... (2 Replies)
Discussion started by: vikus
2 Replies
9. Shell Programming and Scripting
Hi,
i have two files like these:
FILE 1
00:0f:35:1b:0c:00 1402691094.750049000 00:0f:35:1b:0c:00 1402691087.474893000
44:d3:ca:fd:a2:08 1402691091.865127000
30:e4:db:c1:df:de 1402691090.192464000
FILE 2_
00:0F:35 Cisco Systems, Inc
30:E4:DB Cisco Systems, Inc
I need a file 3, that... (5 Replies)
Discussion started by: bertiko
5 Replies
10. Shell Programming and Scripting
I have two csv files : say a.csv, b.csv
a.csv looks like this :
property1,property2,100
property3,property4,200
In a.csv, the combination of column1 and column2 will be unique
b.csv looks like this
property1,property2, 300, t1
property1,property2, 400,t2
property3, property4,800,t1... (2 Replies)
Discussion started by: Lakshmikumari
2 Replies
LEARN ABOUT DEBIAN
funmerge
funmerge(1) SAORD Documentation funmerge(1)
NAME
funmerge - merge one or more Funtools table files
SYNOPSIS
funmerge [-w|-x] -f [colname] <iname1> <iname2> ... <oname>
OPTIONS
-f # output a column specifying file from which this event came
-w # adjust position values using WCS info
-x # adjust position values using WCS info and save old values
DESCRIPTION
funmerge merges FITS data from one or more FITS Binary Table files or raw event files.
The first argument to the program specifies the first input FITS table or raw event file. If "stdin" is specified, data are read from the
standard input. Use Funtools Bracket Notation to specify FITS extensions and row filters. Subsequent arguments specify additional event
files and tables to merge. (NB: Stdin cannot not be used for any of these additional input file arguments.) The last argument is the out-
put FITS file. The columns in each input table must be identical.
If an input file begins with the '@' character, it is processed as an include file, i.e., as a text file containing event file names (as
well as blank lines and/or comment lines starting with the '#' sign). If standard input is specified as an include file ('@stdin'), then
file names are read from the standard input until EOF (^D). Event files and include files can be mixed on a command line.
Rows from each table are written sequentially to the output file. If the switch -f [colname] is specified on the command line, an addi-
tional column is added to each row containing the number of the file from which that row was taken (starting from one). In this case, the
corresponding file names are stored in the header parameters having the prefix FUNFIL, i.e., FUNFIL01, FUNFIL02, etc.
Using the -w switch (or -x switch as described below), funmerge also can adjust the position column values using the WCS information in
each file. (By position columns, we mean the columns that the table is binned on, i.e., those columns defined by the bincols= switch, or
(X,Y) by default.) To perform WCS alignment, the WCS of the first file is taken as the base WCS. Each position in subsequent files is
adjusted by first converting it to the sky coordinate in its own WCS coordinate system, then by converting this sky position to the sky
position of the base WCS, and finally converting back to a pixel position in the base system. Note that in order to perform WCS alignment,
the appropriate WCS and TLMIN/TLMAX keywords must already exist in each FITS file.
When performing WCS alignment, you can save the original positions in the output file by using the -x (for "xtra") switch instead of the
-w switch (i.e., using this switch also implies using -w) The old positions are saved in columns having the same name as the original
positional columns, with the added prefix "OLD_".
Examples:
Merge two tables, and preserve the originating file number for each row in the column called "FILE" (along with the corresponding file name
in the header):
[sh] funmerge -f "FILE" test.ev test2.ev merge.ev
Merge two tables with WCS alignment, saving the old position values in 2 additional columns:
[sh] funmerge -x test.ev test2.ev merge.ev
This program only works on raw event files and binary tables. We have not yet implemented image and array merging.
SEE ALSO
See funtools(7) for a list of Funtools help pages
version 1.4.2 January 2, 2008 funmerge(1)