Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Join not working for comparision

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Join not working for comparision
# 1  
Old 06-12-2013
Join not working for comparision
Hi All,
I have 2 files where the first column of both the files have to be compared and if they match the first six columns of the first file to be extracted in the output file.

Format of files :

File1 : ${SHTEMP}NPBR5.XTR.tmp

Code:
S00016678|129|7|MPF|20090106|E
S00016678|129|7|MPF|20090205|E
S00016678|129|7|MPF|20090305|E
S00016678|129|7|MPF|20090402|E
S00016678|129|7|MPF|20090504|E
S00016678|129|7|MPF|20090602|E
S00016678|129|7|MPF|20090702|E
S00016678|129|7|MPF|20090804|E
S00016678|129|7|MPF|20090902|E
S00016678|129|7|MPF|20091006|E
S00016678|129|7|MPF|20091103|E
S00016678|129|7|MPF|20091203|E
S00017768|45|7|MPF|20081208|E
S00017768|45|7|MPF|20090113|E
S00017768|45|7|MPF|20090218|E
S00017768|90|7|MPF|20090309|E
S00017768|45|7|MPF|20090506|E
S00017768|45|7|MPF|20090605|E
S00017768|45|7|MPF|20090708|E
S00017768|45|3|MPF|20090811|E
S00017768|-45|3|MPF|20090811|E
S00017768|45|7|MPF|20090812|E
S00017768|45|7|MPF|20090915|E
S00017768|45|7|MPF|20091005|E
S00017768|45|7|MPF|20091104|E
S00017768|45|7|MPF|20091210|E
S00049990|258|7|MPF|20090408|E
S00049990|129|7|MPF|20090513|E
S00049990|129|7|MPF|20090612|E
S00049990|129|7|MPF|20090710|E
S00049990|129|7|MPF|20090812|E
S00049990|129|7|MPF|20090909|E
S00049990|129|7|MPF|20091009|E
S00049990|129|7|MPF|20091110|E
S00049990|129|7|MPF|20091210|E
S00059081|138|7|MPF|20080311|E
S00059081|133|7|MPF|20080331|E
S00059081|133|7|MPF|20081211|E
S00059081|128|7|MPF|20090106|E
S00059081|5|7|MPF|20090203|E
S00059081|123|7|MPF|20090203|E
S00059081|5|7|MPF|20090310|E
S00059081|60|7|MPF|20090310|E
S00059081|128|3|MPF|20090421|E
S00059081|5|3|MPF|20090421|E
S00059081|68|7|MPF|20090407|E

File 2 :${SHTEMP}NPBR1.XTR.final

Code:
S00016678|MIDDL|0|MR|019221521A||RL|STD|0|0||E
S00017768|ESSEX|0|MR|018163650A||R|STD|0|0||E
S00059081|PLYMO|0|MR|024266906A||VR|STD|0|0||E
S00001153|MIDDL|0|MR|018099911D||P|STD|0|0||E
S00001156|NORFO|0|MR|010225966A||P|STD|0|0||E
S00001167|MIDDL|0|MR|014143292A||P|STD|0|0||E
S00001263|MIDDL|0|MR|020105100A||P3|STD|0|0||E
S00001283|MIDDL|0|MR|021203506A||P|STD|0|0||E
S00001309|MIDDL|0|MR|010261774A||P|STD|0|0||E
S00001321|MIDDL|0|MR|020206784A||P|STD|0|0||E
S00001382|MIDDL|0|MR|025206271A||P|STD|0|0||E
S00001401|MIDDL|0|MR|030243897A||P|STD|0|0||E
S00001416|MIDDL|0|MR|029071547A||P|STD|0|0||E
S00001423|MIDDL|0|MR|027120380D||R3|STD|0|0||E
S00001441|1044|0|MR|002224916A||U|EG GIC SRX|0|0||E
S00001460|NORFO|0|MR|021208553D||RK|STD|0|0||E
S00001485|1143|0|MR|029127847D||U|EG SRX|0|0||E
S00001493|ESSEX|0|MR|028205925D||RK|STD|0|0||E

Code tried :

Code:
join -t"|" -1 1 -2 1 -o 1.1 1.2 1.3 1.4 1.5 1.6 ${SHTEMP}NPBR5.XTR.tmp ${SHTEMP}NPBR1.XTR.final > ${SHTEMP}NPBR5.XTR.tmp1

Is there a way in awk or sed to do this.
# 2  
Old 06-12-2013
Code:
awk -F\| 'NR==FNR{A[$1]=$0;next}$1 in A{print A[$1]}' ${SHTEMP}NPBR5.XTR.tmp ${SHTEMP}NPBR1.XTR.final

This User Gave Thanks to Yoda For This Post:
nua7
# 3  
Old 06-12-2013
Thanks! Is there a way to include field 3 from file 2 in the output file.

Existing code :

Code:
join -t"|" -1 1 -2 1 -o 1.1 1.2 1.3 1.4 1.5 1.6 2.3 ${SHTEMP}NPBR5.XTR.tmp ${SHTEMP}NPBR1.XTR.final > ${SHTEMP}NPBR5.XTR.tmp1

# 4  
Old 06-12-2013
Quote:
Originally Posted by nua7
Thanks! Is there a way to include field 3 from file 2 in the output file
Code:
awk -F\| 'NR==FNR{A[$1]=$0;next}$1 in A{print A[$1],$3}' OFS=\| ${SHTEMP}NPBR5.XTR.tmp ${SHTEMP}NPBR1.XTR.final

This User Gave Thanks to Yoda For This Post:
nua7
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

UNIX Join not working as expected

Hello All, I'm working on a Shell script to join data from two files using Join command but not able to get the desired output as its throwing me an error: I have sorted the two files on the Column 1 numerically which is used as Join clause File 1: 1,ABC,GGG,20160401 2,XYZ,KKK,20160401... (2 Replies)
Discussion started by: venkat_reddy
2 Replies

2. UNIX for Dummies Questions & Answers

Join not working

Hi all, I'm trying to use the join command to merge two files, but it's not finding lots of the matches. I have three files in total: File A: 31_77 34_46 72_61 85_10 85_23 110_33 144_45 154_25 154_90 170_5 170_44 217_63 255_19 333_20 333_23 333_32 (2 Replies)
Discussion started by: HEP
2 Replies

3. Shell Programming and Scripting

Join not working properly

I want to join two files , with file 1 col 3 and file 2 col 1 as key. The join command is erratic for some reason. File 2 is a master file having all the names, and file 1 has some values. I want to add the names from fil2 in file 1. If I use the original master file, some output is missing. ... (16 Replies)
Discussion started by: ritakadm
16 Replies

4. UNIX for Dummies Questions & Answers

A simple join, but nothing is working out for me

Guys, I want to join two files. You might have seen this many times. I just don't get the desired output. Searching the forum, No proper links :( Input: File1 test1 test2 test3 File2 is bad is not bad Output Needed: test1 is bad test2 is bad (4 Replies)
Discussion started by: PikK45
4 Replies

5. Shell Programming and Scripting

Fixed width file comparision not working

when i used diff/cmp/cat -v commands i am getting the difference cmp command cmp -l file1 file2 |head -1 1300 15 10 Manually checked records. record length and data matched. diff file1 file2 3C3 <record information Manually checked records. record length and data matched.... (4 Replies)
Discussion started by: onesuri
4 Replies

6. Shell Programming and Scripting

Bash join script not working

So i'm currently working on a project where I'm attempting to display information of users from the /etc/passwd file and also another information file holding addition information about users. Problem is I've been trying to join the two files together and have all of the information about each... (2 Replies)
Discussion started by: Nostyx
2 Replies

7. Shell Programming and Scripting

String comparision not working

have written a simple shell script to do some automation work. Basically the script searches for all the files in the current path and if the file is a specified one, it does some action. Below are the relevant lines --- #!/bin/bash 1.for i in ls * 2.do 3.if 4.then .... //do something... (3 Replies)
Discussion started by: Dev_Sharma987
3 Replies

8. UNIX for Dummies Questions & Answers

Join 2 files with multiple columns: awk/grep/join?

Hello, My apologies if this has been posted elsewhere, I have had a look at several threads but I am still confused how to use these functions. I have two files, each with 5 columns: File A: (tab-delimited) PDB CHAIN Start End Fragment 1avq A 171 176 awyfan 1avq A 172 177 wyfany 1c7k A 2 7... (3 Replies)
Discussion started by: InfoSeeker
3 Replies

9. Shell Programming and Scripting

Merging fields --- Join is not working

Hi GUYS sorry for putting simple query. I have tried the methods posted previously in this site but I'm unable to join the similar values in different columns of different files. I used sort -u file1 and join but no use.?? I'm attaching my inputfiles.Plz chek them I have two files. 1st file... (10 Replies)
Discussion started by: repinementer
10 Replies

10. UNIX for Dummies Questions & Answers

join not working

I was trying to merge the following two example files using their first field: join -1 1 -2 1 file1 file 2 but nothing is produced. The expected result should be: rs1005152 7 q21.3 3 It appears that the length of the first field in file1 is causing the problem. Any suggesting on how to... (12 Replies)
Discussion started by: gamma_user
12 Replies
Login or Register to Ask a Question