Sponsored Content
Top Forums Shell Programming and Scripting Compare three files based on two fields Post 302748747 by pamu on Thursday 27th of December 2012 12:49:38 AM
Old 12-27-2012
Code:
$ awk -F "|" 'f==1{A[$1,$2]++;B[$1,$2]=$1 FS $2 FS FILENAME}
f==2{A[$1,$2]++;B[$1,$2]=B[$1,$2]?B[$1,$2]","FILENAME:$1 FS $2 FS FILENAME}
f==3{A[$1,$2]++;B[$1,$2]=B[$1,$2]?B[$1,$2]","FILENAME:$1 FS $2 FS FILENAME}END{
for (i in A){if(A[i]<3){print B[i]"|"}}}
' f=1 file1 f=2 file2 f=3 file3

2677|47877074|file2,file3|
2677|47877258|file1,file2|
2677|47877099|file1|
2677|47877350|file2|
2677|47877351|file1|

EDIT:

Minimized it's length lit bit..Smilie using function..Smilie

Code:
awk -F "|" 'function define_arr() {
A[$1,$2]++;
B[$1,$2]=B[$1,$2]?B[$1,$2]","FILENAME:$1 FS $2 FS FILENAME
}
f==1{define_arr()}
f==2{define_arr()}
f==3{define_arr()}
END{for (i in A){if(A[i]<3){print B[i]"|"}}}' f=1 file1 f=2 file2 f=3 file3


Last edited by pamu; 12-27-2012 at 02:11 AM..
This User Gave Thanks to pamu For This Post:
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare two files based on values of fields.

Hi All, I have two files and data looks like this: File1 Contents #Field1,Field2 Dist_Center_file1.txt;21 Dist_Center_file3.txt;20 Dist_Center_file2.txt;20 File2 Contents (*** No Header ***) Dist_Center_file1.txt;23 Dist_Center_file2.txt;20 Dist_Center_file3.txt;20 I have... (4 Replies)
Discussion started by: Hangman2
4 Replies

2. Shell Programming and Scripting

Compare fields in 2 files using AWK

Hi unix gurus, I have a urgent requirement, I need to write a AWK script to compare each fields in 2 files using AWK. Basically my output should be like this. file1 row|num1|num2|num3 1|one|two|three 2|one|two|three file2 row|num1|num2|num3 1|one|two|three 2|one|two|four ... (5 Replies)
Discussion started by: rashmisb
5 Replies

3. Shell Programming and Scripting

AWK Compare files, different fields, output

Hi All, Looking for a quick AWK script to output some differences between two files. FILE1 device1 1.1.1.1 PINGS device1 2.2.2.2 PINGS FILE2 2862 SITE1 device1-prod 1.1.1.1 icmp - 0 ... (4 Replies)
Discussion started by: stacky69
4 Replies

4. Shell Programming and Scripting

Compare files with fields separated with semicolon

Dear experts I have files like ABD : 5869 events, relative ratio : 1.173800E-01 , sum of ratios : 1.173800E-01 VBD : 12147 events, relative ratio : 2.429400E-01 , sum of ratios : 3.603200E-01 SDF : 17000 events, relative ratio : 3.400000E-01 , sum of ratios : 7.003200E-01 OIP: 14984... (9 Replies)
Discussion started by: Alkass
9 Replies

5. Shell Programming and Scripting

compare fields in different files

HI I'm having some troubles to compare and permut diffrent fields indexed with another filed like the following example `: file1 1 1 2 2 3 3 file2 7 1 9 2 10 3 result------------------- (6 Replies)
Discussion started by: yassinegoth
6 Replies

6. Shell Programming and Scripting

Compare fields in files

Hi, I need the most efficient way of comparing the following and arriving at the result I have a file which has entries like, File1: 1|2|5|7|8|2|3|6|3|1 File2: 1|2|3|1|2|7|9|2 I need to compare the entries in these two file with those of a general file, 1|2|3|5|2|5|6|9|3|1... (7 Replies)
Discussion started by: pradebban
7 Replies

7. Shell Programming and Scripting

Compare two fields in text files?

Hi, I have two text files, compare column one in both the files and if it matches then the output should contain the id in column one, the number and the description. Both the files are sorted. Is there a one liner to get this done, kindly help. Thank you File 1: NC_000964 92.33 ... (2 Replies)
Discussion started by: pulikoti
2 Replies

8. UNIX for Dummies Questions & Answers

Compare 2 fields in 2 files

I am trying to compare two files (separted by a pipe) using 2 fields (field 1,3 from fileA and 1,2 from fileB) if the two files match i want the whole record of fileA adding the extra fields left from fileB. 1. A.txt cat|floffy|12|anything|anythings cat|kitty|15|lala|lalala... (6 Replies)
Discussion started by: sabercats
6 Replies

9. Shell Programming and Scripting

Compare fields in two files

Hi, I am trying to check two files based on certain string and field. cat f1 source=\GREP\" hi this \\ source=\SED\" skdmsmd dnksdns source=\PERL\" cat f2 source=\SED\" source=\GREP\" vlamskds amdksk m source=\AWK\" awk \here\" (3 Replies)
Discussion started by: greet_sed
3 Replies

10. UNIX for Beginners Questions & Answers

Is there a UNIX command that can compare fields of files with differing number of fields?

Hi, Below are the sample files. x.txt is from an Excel file that is a list of users from Windows and y.txt is a list of database account. $ head -500 x.txt y.txt ==> x.txt <== TEST01 APP_USER_PROFILE USER03 APP_USER_PROFILE TEST02 APP_USER_EXP_PROFILE TEST04 APP_USER_PROFILE USER01 ... (3 Replies)
Discussion started by: newbie_01
3 Replies
HOBBITLAUNCH(8) 					      System Manager's Manual						   HOBBITLAUNCH(8)

NAME
hobbitlaunch - Master program to launch other Xymon programs SYNOPSIS
hobbitlaunch [options] DESCRIPTION
hobbitlaunch(8) is the main program that controls the execution and scheduling of all of the components in the Xymon system. hobbitlaunch allows the administrator to add, remove or change the set of Xymon applications and extensions without restarting Xymon - hob- bitlaunch will automatically notice any changes in the set of tasks, and change the scheduling of activities accordingly. hobbitlaunch also allows the administrator to setup specific logfiles for each component of the Xymon system, instead of getting output from all components logged to a single file. OPTIONS
--env=FILENAME Loads the environment from FILENAME before starting other tools. The environment defined by FILENAME is the default, it can be overridden by the ENVFILE option in hobbitlaunch.cfg(5) --config=FILENAME This option defines the file that hobbitlaunch scans for tasks it must launch. A description of this file is in hobbitlaunch.cfg(5) The default tasklist is /etc/hobbitlaunch.cfg --log=FILENAME Defines the logfile where hobbitlaunch logs information about failures to launch tasks and other data about the operation of hobbit- launch. Logs from individual tasks are defined in the hobbitlaunch.cfg file. By default this is logged to stdout. --pidfile=FILENAME Filename which hobbitlaunch saves its own process-ID to. Commonly used by automated start/stop scripts. --verbose Logs the launch of all tasks to the logfile. Note that the logfile may become quite large if you enable this. --dump Just dump the contents of the hobbitlaunch.cfg file after parsing it. Used for debugging. --debug Enable debugging output while running. --no-daemon hobbitlaunch normally detaches from the controlling tty and runs as a background task. This option keeps it running in the fore- ground. STARTING TASKS
hobbitlaunch will read the configuration file and start all of the tasks listed there. If a task completes abnormally (i.e. terminated by a signal or with a non-zero exit status), then hobbitlaunch will attempt to restart it 5 times. If it still will not run, then the task is disabled for 10 minutes. This will be logged to the hobbitlaunch logfile. If the configuration file changes, hobbitlaunch will re-read it and notice any changes. If a running task was removed from the configura- tion, then the task is stopped. If a new task was added, it will be started. If the command used for a task changed, or it was given a new environment definition file, or the logfile was changed, then the task is stopped and restarted with the new definition. SEE ALSO
hobbitlaunch.cfg(5), xymon(7) Xymon Version 4.2.3: 4 Feb 2009 HOBBITLAUNCH(8)
All times are GMT -4. The time now is 03:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy