file merge using awk


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers file merge using awk
# 1  
Old 04-07-2011
Question file merge using awk

Hi All,

I have 2 csv files. 1st file has 10 columns and the 2nd file has 12 columns.
The requirement is, if the 4th column of file1 matches with the 4th column of file2, then append the 12th column of file2 with file1.

Both files have equal number of lines and the 4th column values are unique.
I tried the below command after googling. Can some one please explain the command.
Code:
awk -F, 'BEGIN { while (( getline < "file2" )>0) a[$4]=$12 } 
         a[$4] { print a[$4]","$0 }' file1  >  outputFile

The problem is, this command works only if the header in both files are removed. I have 2 lines of header in file1 and 1 line of header in file2. Is there any way to remove the header by tweaking the above command, without creating new files.

Thanks in advance!
Ganesh

Last edited by Franklin52; 04-07-2011 at 09:12 AM.. Reason: Please use code tags
# 2  
Old 04-07-2011
Something like this?
Code:
awk 'NR==FNR{a[$4]=$12; next}
FNR>1 && a[$4]{print $0, a[$4]}' file2 file1

 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk can't open file; file merge attempt

Dear all, I have an AWK related issue. I have two data files; the first, FileA has fewer lines, the second, FileB has more. FileA is a subset of FileB . Both files are tab delimited. What I want to do? When the first two columns for FileA match the first two columns of FileB, I want to... (4 Replies)
Discussion started by: A_Human_Person
4 Replies

2. Shell Programming and Scripting

Merge values from multiple directories into one file in awk or bash

I am trying to merge or combine all $1 values in validation.txt from multiple directories into one new file and output it here tab-delimited:/home/cmccabe/Desktop/20x/total/total.txt. Each $2 value and the header would then be a new field in total.txt. I am not sure how to go about this as cat is... (2 Replies)
Discussion started by: cmccabe
2 Replies

3. Shell Programming and Scripting

How to merge fields in a single file using awk ?

Hi, From a file, using: awk -F" " '{ if (NF == 6) print $1, $2, $3, $4, $5, $6; if (NF == 5) print $1, $2, $3, $4, $5; }' i printed out the required output. But i'm trying to merge the columns. Please look at the desired output. Any suggestions? Thanks Output: 00015 PSA1 ... (5 Replies)
Discussion started by: web2moha
5 Replies

4. Shell Programming and Scripting

Merge multiple lines in same file with common key using awk

I've been a Unix admin for nearly 30 years and never learned AWK. I've seen several similar posts here, but haven't been able to adapt the answers to my situation. AWK is so damn cryptic! ;) I have a single file with ~900 lines (CSV list). Each line starts with an ID, but with different stuff... (6 Replies)
Discussion started by: protosd
6 Replies

5. UNIX for Dummies Questions & Answers

merge files along with file names (awk)?

Dear programmers, I have a question about conditionally merging multiple files and having their file names in the first column. Input files: file.1.extension file.2.extension file.3.extension file.4.extension ... file.1000.extension where each file looks like this (with multiple lines):... (5 Replies)
Discussion started by: wei.deng
5 Replies

6. Shell Programming and Scripting

Another awk merge

File1 01C6,039E,RDF1+TDEV,120(2),1507_3RAID5,33 01C8,0E46,RDF1+TDEV,200(8),1507_3RAID5,33 01D4,045E,RDF1+TDEV,8,1507_3RAID5,33 01D5,045F,RDF1+TDEV,8,1507_3RAID5,33 File2 01C6,AA,BB,CC 01C8,,,NN 01D5,BB,KK, 0122,GG,, Ouput ... (2 Replies)
Discussion started by: greycells
2 Replies

7. Shell Programming and Scripting

two file merge with awk

Help I read a file that has 2 fields. look for in a second file the first field and update it with the second field of first file. file1 1131518fat11416.txt ../newaod/2001/04/2001-04-00129233-1.txt file2 INSERT INTO tabric VALUES... (2 Replies)
Discussion started by: mcarlo65
2 Replies

8. Shell Programming and Scripting

please help to merge file with awk or sed

hi experts please help me,thanks in advance file1 arch : x86 install : pass make os : pass make build kernel : pass=100 failed=45 usb storage pass : The Linux Kernel Archives file2 arch : ppc install : failed make os : http://kernel.org (6 Replies)
Discussion started by: yanglei_fage
6 Replies

9. Shell Programming and Scripting

Merge lines in a file with Awk - incorrect output

Hi, I would like: FastEthernet0/0 is up, line protocol is up 0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored 0 output errors, 0 collisions, 0 interface resets Serial1/0:0 is up, line protocol is up 0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort 0... (14 Replies)
Discussion started by: mv652
14 Replies

10. Shell Programming and Scripting

merge two files into one file use awk

Hi, guys. I have one question: I have two files: passwd and shadow (the number of records in these files are not equal)the contents of them are below: passwd: ************** ftp:x:24:24: sshd:x:71:65: uucp:x:10:14: brownj:x:5005:1000: sherrys: x :5006:1000: ... ************* ... (2 Replies)
Discussion started by: daikeyang
2 Replies
Login or Register to Ask a Question