Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Finding out the common lines in two files using 4 fields with the help of awk and UNIX
Top Forums Shell Programming and Scripting Finding out the common lines in two files using 4 fields with the help of awk and UNIX Post 302847535 by Subbeh on Tuesday 27th of August 2013 07:24:01 AM
Old 08-27-2013
Try this (Assuming it's tab separated):
Code:
awk -F\t 'NR==FNR{a[$1,$2,$4,$5]=$0;next}($1,$2,$4,$5) in a{print $0;print a[$1,$2,$4,$5]}' file1 file2

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

To find all common lines from 'n' no. of files

Hi, I have one situation. I have some 6-7 no. of files in one directory & I have to extract all the lines which exist in all these files. means I need to extract all common lines from all these files & put them in a separate file. Please help. I know it could be done with the help of... (11 Replies)
Discussion started by: The Observer
11 Replies

2. Shell Programming and Scripting

Common lines from files

Hello guys, I need a script to get the common lines from two files with a criteria that if the first two columns match then I keep the maximum value of the 3rd column.(tab separated columns) Sample input: file1: 111 222 0.1 333 444 0.5 555 666 0.4 file 2: 111 222 0.7 555 666... (5 Replies)
Discussion started by: jaysean
5 Replies

3. Shell Programming and Scripting

Common lines from files

Hello guys, I need a script to get the common lines from two files with a criteria that if the first two columns match then I keep the maximum value of the 5th column.(tab separated columns) . 3rd and 4th columns corresponds to the row which has highest value for the 5th column. Sample... (2 Replies)
Discussion started by: jaysean
2 Replies

4. Shell Programming and Scripting

Get common lines from multiple files

FileA chr1 31237964 NP_001018494.1 PUM1 M340L chr1 31237964 NP_055491.1 PUM1 M340L chr1 33251518 NP_037543.1 AK2 H191D chr1 33251518 NP_001616.1 AK2 H191D chr1 57027345 NP_001004303.2 C1orf168 P270S FileB chr1 ... (9 Replies)
Discussion started by: genehunter
9 Replies

5. Shell Programming and Scripting

awk- comparing fields from the same column, finding discontinuities.

Hello, I have a file with two fields. The first field repeats itself for quite a while but the second field changes. What I want to do is to go through the first column until its value changes (and while it doesn't, verify that the second field is in a sequence from 0-15). Example input: ... (13 Replies)
Discussion started by: acsg
13 Replies

6. Shell Programming and Scripting

finding common numbers (contents) across 2 or 3 files

I have 3 files which are tab delimited and have numbers in it. file 1 1 2 3 4 5 6 7 File 2 3 5 7 8 File 3 1 (4 Replies)
Discussion started by: Lucky Ali
4 Replies

7. UNIX for Dummies Questions & Answers

keeping last record among group of records with common fields (awk)

input: ref.1;rack.1;1 #group1 ref.1;rack.1;2 #group1 ref.1;rack.2;1 #group2 ref.2;rack.3;1 #group3 ref.2;rack.3;2 #group3 ref.2;rack.3;3 #group3 Among records from same group (i.e. with same 1st and 2nd field - separated by ";"), I would need to keep the last record... (5 Replies)
Discussion started by: beca123456
5 Replies

8. UNIX for Dummies Questions & Answers

Filter lines common in two files

Thanks everyone. I got that problem solved. I require one more help here. (Yes, UNIX definitely seems to be fun and useful, and I WILL eventually learn it for myself. But I am now on a different project and don't really have time to go through all the basics. So, I will really appreciate some... (6 Replies)
Discussion started by: latsyrc
6 Replies

9. UNIX for Beginners Questions & Answers

Awk: output lines with common field to separate files

Hi, A beginner one. my input.tab (tab-separated): h1 h2 h3 h4 h5 item1 grpA 2 3 customer1 item2 grpB 4 6 customer1 item3 grpA 5 9 customer1 item4 grpA 0 0 customer2 item5 grpA 9 1 customer2 objective: output a file for each customer ($5) with the item number ($1) only if $2 matches... (2 Replies)
Discussion started by: beca123456
2 Replies

10. UNIX for Beginners Questions & Answers

Is there a UNIX command that can compare fields of files with differing number of fields?

Hi, Below are the sample files. x.txt is from an Excel file that is a list of users from Windows and y.txt is a list of database account. $ head -500 x.txt y.txt ==> x.txt <== TEST01 APP_USER_PROFILE USER03 APP_USER_PROFILE TEST02 APP_USER_EXP_PROFILE TEST04 APP_USER_PROFILE USER01 ... (3 Replies)
Discussion started by: newbie_01
3 Replies

LEARN ABOUT MINIX

paste

PASTE(1)						      General Commands Manual							  PASTE(1)

NAME

       paste - paste multiple files together

SYNOPSIS

       paste [-s] [-d list] file...

OPTIONS

       -d     Set delimiter used to separate columns to list.

       -s     Print files sequentially, file k on line k.

EXAMPLES

       paste file1 file2   # Print file1 in col 1, file2 in col 2

       paste -s f1 f2	   # Print f1 on line 1 and f2 on line 2

       paste -d : file1 file2
			   # Print the lines separated by a colon

DESCRIPTION

       Paste  concatenates  corresponding  lines of the given input files and writes them to standard output. The lines of the different files are
       separated by the delimiters given with the option -s. If no list is given, a tab is substituted for every linefeed, except  the	last  one.
       If  end-of-file	is hit on an input file, subsequent lines are empty.  Suppose a set of k files each has one word per line.  Then the paste
       output will have k columns, with the contents of file j in column j.  If the -s flag is given, then the first file is on line 1, the second
       file on line 2, etc.  In effect, -s turns the output sideways.

       If  a list of delimiters is given, they are used in turn.  The C escape sequences 
, 	, \, and  are used for linefeed, tab, backslash,
       and the null string, respectively.

																	  PASTE(1)
All times are GMT -4. The time now is 12:27 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy