Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Compare three files based on two fields
Top Forums Shell Programming and Scripting Compare three files based on two fields Post 302748747 by pamu on Thursday 27th of December 2012 12:49:38 AM
Old 12-27-2012
Code:
$ awk -F "|" 'f==1{A[$1,$2]++;B[$1,$2]=$1 FS $2 FS FILENAME}
f==2{A[$1,$2]++;B[$1,$2]=B[$1,$2]?B[$1,$2]","FILENAME:$1 FS $2 FS FILENAME}
f==3{A[$1,$2]++;B[$1,$2]=B[$1,$2]?B[$1,$2]","FILENAME:$1 FS $2 FS FILENAME}END{
for (i in A){if(A[i]<3){print B[i]"|"}}}
' f=1 file1 f=2 file2 f=3 file3

2677|47877074|file2,file3|
2677|47877258|file1,file2|
2677|47877099|file1|
2677|47877350|file2|
2677|47877351|file1|

EDIT:

Minimized it's length lit bit..Smilie using function..Smilie

Code:
awk -F "|" 'function define_arr() {
A[$1,$2]++;
B[$1,$2]=B[$1,$2]?B[$1,$2]","FILENAME:$1 FS $2 FS FILENAME
}
f==1{define_arr()}
f==2{define_arr()}
f==3{define_arr()}
END{for (i in A){if(A[i]<3){print B[i]"|"}}}' f=1 file1 f=2 file2 f=3 file3

Last edited by pamu; 12-27-2012 at 02:11 AM..
This User Gave Thanks to pamu For This Post:
sathyaonnuix
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare two files based on values of fields.

Hi All, I have two files and data looks like this: File1 Contents #Field1,Field2 Dist_Center_file1.txt;21 Dist_Center_file3.txt;20 Dist_Center_file2.txt;20 File2 Contents (*** No Header ***) Dist_Center_file1.txt;23 Dist_Center_file2.txt;20 Dist_Center_file3.txt;20 I have... (4 Replies)
Discussion started by: Hangman2
4 Replies

2. Shell Programming and Scripting

Compare fields in 2 files using AWK

Hi unix gurus, I have a urgent requirement, I need to write a AWK script to compare each fields in 2 files using AWK. Basically my output should be like this. file1 row|num1|num2|num3 1|one|two|three 2|one|two|three file2 row|num1|num2|num3 1|one|two|three 2|one|two|four ... (5 Replies)
Discussion started by: rashmisb
5 Replies

3. Shell Programming and Scripting

AWK Compare files, different fields, output

Hi All, Looking for a quick AWK script to output some differences between two files. FILE1 device1 1.1.1.1 PINGS device1 2.2.2.2 PINGS FILE2 2862 SITE1 device1-prod 1.1.1.1 icmp - 0 ... (4 Replies)
Discussion started by: stacky69
4 Replies

4. Shell Programming and Scripting

Compare files with fields separated with semicolon

Dear experts I have files like ABD : 5869 events, relative ratio : 1.173800E-01 , sum of ratios : 1.173800E-01 VBD : 12147 events, relative ratio : 2.429400E-01 , sum of ratios : 3.603200E-01 SDF : 17000 events, relative ratio : 3.400000E-01 , sum of ratios : 7.003200E-01 OIP: 14984... (9 Replies)
Discussion started by: Alkass
9 Replies

5. Shell Programming and Scripting

compare fields in different files

HI I'm having some troubles to compare and permut diffrent fields indexed with another filed like the following example `: file1 1 1 2 2 3 3 file2 7 1 9 2 10 3 result------------------- (6 Replies)
Discussion started by: yassinegoth
6 Replies

6. Shell Programming and Scripting

Compare fields in files

Hi, I need the most efficient way of comparing the following and arriving at the result I have a file which has entries like, File1: 1|2|5|7|8|2|3|6|3|1 File2: 1|2|3|1|2|7|9|2 I need to compare the entries in these two file with those of a general file, 1|2|3|5|2|5|6|9|3|1... (7 Replies)
Discussion started by: pradebban
7 Replies

7. Shell Programming and Scripting

Compare two fields in text files?

Hi, I have two text files, compare column one in both the files and if it matches then the output should contain the id in column one, the number and the description. Both the files are sorted. Is there a one liner to get this done, kindly help. Thank you File 1: NC_000964 92.33 ... (2 Replies)
Discussion started by: pulikoti
2 Replies

8. UNIX for Dummies Questions & Answers

Compare 2 fields in 2 files

I am trying to compare two files (separted by a pipe) using 2 fields (field 1,3 from fileA and 1,2 from fileB) if the two files match i want the whole record of fileA adding the extra fields left from fileB. 1. A.txt cat|floffy|12|anything|anythings cat|kitty|15|lala|lalala... (6 Replies)
Discussion started by: sabercats
6 Replies

9. Shell Programming and Scripting

Compare fields in two files

Hi, I am trying to check two files based on certain string and field. cat f1 source=\GREP\" hi this \\ source=\SED\" skdmsmd dnksdns source=\PERL\" cat f2 source=\SED\" source=\GREP\" vlamskds amdksk m source=\AWK\" awk \here\" (3 Replies)
Discussion started by: greet_sed
3 Replies

10. UNIX for Beginners Questions & Answers

Is there a UNIX command that can compare fields of files with differing number of fields?

Hi, Below are the sample files. x.txt is from an Excel file that is a list of users from Windows and y.txt is a list of database account. $ head -500 x.txt y.txt ==> x.txt <== TEST01 APP_USER_PROFILE USER03 APP_USER_PROFILE TEST02 APP_USER_EXP_PROFILE TEST04 APP_USER_PROFILE USER01 ... (3 Replies)
Discussion started by: newbie_01
3 Replies

LEARN ABOUT NETBSD

info

INFO(1) 							   User Commands							   INFO(1)

NAME

       info - read Info documents

SYNOPSIS

       info [OPTION]... [MENU-ITEM...]

DESCRIPTION

       Read documentation in Info format.

OPTIONS

       --apropos=STRING
	      look up STRING in all indices of all manuals.

       -d, --directory=DIR
	      add DIR to INFOPATH.

       --dribble=FILENAME
	      remember user keystrokes in FILENAME.

       -f, --file=FILENAME
	      specify Info file to visit.

       -h, --help
	      display this help and exit.

       --index-search=STRING
	      go to node pointed by index entry STRING.

       -n, --node=NODENAME
	      specify nodes in first visited Info file.

       -o, --output=FILENAME
	      output selected nodes to FILENAME.

       -R, --raw-escapes
	      output "raw" ANSI escapes (default).

       --no-raw-escapes
	      output escapes as literal text.

       --restore=FILENAME
	      read initial keystrokes from FILENAME.

       -O, --show-options, --usage
	      go to command-line options node.

       --subnodes
	      recursively output menu items.

       -w, --where, --location
	      print physical location of Info file.

       --vi-keys
	      use vi-like and less-like key bindings.

       --version
	      display version information and exit.

       The first non-option argument, if present, is the menu entry to start from; it is searched for in all `dir' files along INFOPATH.  If it is
       not present, info merges all `dir' files and shows the result.  Any remaining arguments are treated as the names of menu items relative	to
       the initial node visited.

EXAMPLES

       info   show top-level dir menu

       info emacs
	      start at emacs node from top-level dir

       info emacs buffers
	      start at buffers node within emacs manual

       info --show-options emacs
	      start at node with emacs' command line options

       info -f ./foo.info
	      show file ./foo.info, not searching dir

REPORTING BUGS

       Email   bug   reports   to   bug-texinfo@gnu.org,   general   questions	 and  discussion  to  help-texinfo@gnu.org.   Texinfo  home  page:
       http://www.gnu.org/software/texinfo/

COPYRIGHT

       Copyright (C) 2004 Free Software Foundation, Inc.  There is NO warranty.  You may redistribute this software under the  terms  of  the  GNU
       General Public License.	For more information about these matters, see the files named COPYING.

info 4.8							   December 2004							   INFO(1)
All times are GMT -4. The time now is 09:12 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy