Compare columns of 2 files based on condition defined in a different file Post: 302469598

Sponsored Content

Top Forums Shell Programming and Scripting Compare columns of 2 files based on condition defined in a different file Post 302469598 by pravin27 on Sunday 7th of November 2010 05:44:26 AM

11-07-2010

Registered User

I hope this will help you.

Code:

awk -F'|' 'NR==FNR && NR>1 {a[++i]=$1$3;next}   #Read first file i.e. control_file starting from line 2 and fill the  array 'a' with value $1$3 i.e. Key and output field
            FNR>1 { if (b[FNR]) { c[FNR]=$0} else { b[FNR]=$0} } #Read file1 and file2 and fill the array 'b' for file1 and 'c' for file2
            END {
                for(k in c) {
                             split(c[k],d,"|");split(b[k],e,"|") ; # fill the array 'd' and 'e' by spilting record into fields of file1 and file2
                             for (j=1;j<=6;j++) {
                                                 if (a[j]=="YY") { #if key and output both are 'Y' then print the field as it is
                                                                  printf "%s|", d[j]
                                                                  } 
                                                 else if(a[j] != "NN") {  #if key and output both are not 'N'
                                                                        printf "%s|" ,(d[j]==e[j])?"Y":"N" #if field from file1 and file2 same then print 'Y' else 'N'
                                                                        }
                                                  }printf "\n"
                             }
                 }' control_file file1 file2

pravin27

View Public Profile for pravin27

Find all posts by pravin27

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

compare two columns of different files and print the matching second file..

Hi, I have two tab separated files; file1: S.No ddi fi cu o/l t+ t- 1 0.5 0.6 o 0.1 0.2 2 0.2 0.3 l 0.3 0.4 3 0.5 0.8 l 0.1 0.6 ...

2. Shell Programming and Scripting

How to compare 2 files & get only few columns based on a condition related to both files?

Hiiiii friends I have 2 files which contains huge data & few lines of it are as shown below File1: b.dat(which has 21 columns) SSR 1976 8 12 13 10 44.00 39.0700 70.7800 7.0 0 0.00 0 2.78 0.00 0.00 0 0.00 2.78 0 NULL ISC 1976 8 12 22 32 37.39 36.2942 70.7338...

3. Shell Programming and Scripting

compare 2 files based on columns

Hi Experts, Is there a way to compare 2 files by columns and print matching cases. I have 2 files as below, I want cases where col1 and col2 in f1 matches col1 and col2 in f2 to be printed as output. The separator is space. I want the output to have col1 col2 col 3 from both files printed...

4. Shell Programming and Scripting

compare 2 files and extract the data which is not present in other file with condition

I have 2 files whose data's are as follows : fileA 00 lieferungen 00 attractiop 01 done 02 forness 03 rasp 04 alwaysisng 04 funny 05 done1 fileB alwayssng dkhf fdgdfg dfgdg sdjkgkdfjg funny rasp

5. Shell Programming and Scripting

compare 2 files and return unique lines in each file (based on condition)

hi my problem is little complicated one. i have 2 files which appear like this file 1 abbsss:aa:22:34:as akl abc 1234 mkilll:as:ss:23:qs asc abc 0987 mlopii:cd:wq:24:as asd abc 7866 file2 lkoaa:as:24:32:sa alk abc 3245 lkmo:as:34:43:qs qsa abc 0987 kloia:ds:45:56:sa acq abc 7805 i...

6. Shell Programming and Scripting

Compare files in a folder based on another file

I have a file named file.txt that looks as follows //class1.txt 45 234 67 89 90 //class2.txt 456 34 78 89 120 class1 and class2.txt are the names of files in a folder named folder1. The content of class1.txt file in folder1 67 9 89 5 234 9The content of class2.txt file in...

7. Shell Programming and Scripting

Extracting rows and columns in a matrix based on condition

Hi I have a matrix with n rows and m columns like below example. i want to extract all the pairs with values <200. Input A B C D A 100 206 51 300 B 206 100 72 48 C 351 22 100 198 D 13 989 150 100 Output format A,A:200 A,C:51 B,B:100...

8. Shell Programming and Scripting

Convert rows to columns based on condition

I have a file some thing like this: GN Name=YWHAB; RC TISSUE=Keratinocyte; RC TISSUE=Thymus; CC -!- FUNCTION: Adapter protein implicated in the regulation of a large CC spectrum of both general and specialized signaling pathways GN Name=YWHAE; RC TISSUE=Liver; RC ...

9. Shell Programming and Scripting

[Solved] awk compare two different columns of two files and print all from both file

Hi, I want to compare two columns from file1 with another two column of file2 and print matched and unmatched column like this File1 1 rs1 abc 3 rs4 xyz 1 rs3 stu File2 1 kkk rs1 AA 10 1 aaa rs2 DD 20 1 ccc ...

10. Shell Programming and Scripting

I have this list of files . Now I will have to pick the latest file based on some condition

3679 Jul 21 23:59 belk_rpo_error_**po9324892**_07212014.log 0 Jul 22 23:59 belk_rpo_error_**po9324892**_07222014.log 3679 Jul 23 23:59 belk_rpo_error_**po9324892**_07232014.log 22 Jul 22 06:30 belk_rpo_error_**po9324267**_07012014.log 0 Jul 20 05:50...

LEARN ABOUT BSD

mv

MV(1)							      General Commands Manual							     MV(1)

NAME

       mv - move or rename files

SYNOPSIS

       mv [ -i ] [ -f ] [ - ] file1 file2

       mv [ -i ] [ -f ] [ - ] file ... directory

DESCRIPTION

       Mv moves (changes the name of) file1 to file2.

       If file2 already exists, it is removed before file1 is moved.  If file2 has a mode which forbids writing, mv prints the mode (see chmod(2))
       and reads the standard input to obtain a line; if the line begins with y, the move takes place; if not, mv exits.

       In the second form, one or more files (plain files or directories) are moved to the directory with their original file-names.

       Mv refuses to move a file onto itself.

       Options:

       -i     stands for interactive mode. Whenever a move is to supercede an existing file, the user is prompted by the name of the file followed
	      by  a  question mark. If he answers with a line starting with 'y', the move continues. Any other reply prevents the move from occur-
	      ring.

       -f     stands for force. This option overrides any mode restrictions or the -i switch.

       -      means interpret all the following arguments to mv as file names.	This allows file names starting with minus.

SEE ALSO

       cp(1), ln(1)

BUGS

       If file1 and file2 lie on different file systems, mv must copy the file and delete the original.  In this case the owner name becomes  that
       of the copying process and any linking relationship with other files is lost.

4th Berkeley Distribution					  April 29, 1985							     MV(1)