Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Compare files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Compare files
# 8  
Old 11-05-2012
I would like the output to the three different files .Please let me know how could I do this. I really appreciate your help

Regards,
Raj

---------- Post updated at 12:50 PM ---------- Previous update was at 12:37 PM ----------

Pamu

I tried your code but it throwing syntax error as below:

Code:
awk 'BEGIN{print "Common"}NR==FNR{A[$1]=$0;next}{if(A[$13]){print $0;delete A[$3]}else{NF1[$0]=$0}}
> > END{print "\nNot in file2.txt";for(i in A){if(A[i]){print A[i]}}
> > print "\nNot in file1.txt"; for (i in NF1){print i}}' file1.txt  file2.txt
awk: cmd. line:1: > END{print "\nNot in file2.txt";for(i in A){if(A[i]){print A[i]}}
awk: cmd. line:1: ^ syntax error
awk: cmd. line:2: > print "\nNot in file1.txt"; for (i in NF1){print i}}
awk: cmd. line:2: ^ syntax error

Please help me in fixing it.

Thanks
raj
Last edited by Franklin52; 11-06-2012 at 03:43 AM.. Reason: Please use code tags for data and code samples
# 9  
Old 11-05-2012
try this to create three diff files.

Code:
awk 'NR==FNR{A[$1]=$0;next}{if(A[$3]){print > "Common";delete A[$3]}else{NF1[$0]=$0}}
END{for(i in A){if(A[i]){print A[i] > "NFile2"}}
for (i in NF1){print i > "NFile1"}}' file1 file2

# 10  
Old 11-05-2012
Pamu,
Somehow the code is not working. The "common" file is not created and also the records which are written to "notinfile1" file can be found in the file 1 and the records which are written to "notinfile2" file can be found in the file 2 . Please let me whether I am missing anything. My actual file 1 has 50 columns in which I need to compare Col1 field to that Col 13 field in Second file which has 13 columns .Here is the code :
Code:
awk 'NR==FNR{A[$1]=$0;next}{if(A[$13]){print > "Common.txt";delete A[$13]}else{NF1[$0]=$0}}
> END{for(i in A){if(A[i]){print A[i] > "NotinFile2.txt"}}
> for (i in NF1){print i > "NotinFile1"}}' File1.txt File2.txt

Please help me whether I missed anything

Thanks
Raj
Last edited by Franklin52; 11-06-2012 at 03:43 AM..
# 11  
Old 11-06-2012
Please check if there is any different value for column 1 and column 13 for respective files. May be there is problem is FS. Please check.

Here it works perfect..Smilie

Code:
$ cat file1
Col1 Col2
1      aa
2      bb
3      dd
4      ee
5      ff

Code:
$ cat file2
col1 col2 col3
11    aa   1
12    bb   3
13    cc   4
35    sdf  9

Code:
$ awk 'NR==FNR{A[$1]=$0;next}{if(A[$3]){print > "Common";delete A[$3]}else{NF1[$0]=$0}}
END{for(i in A){if(A[i]){print A[i] > "NFile2"}}
for (i in NF1){print i > "NFile1"}}' file1 file2

Code:
$ ls -lt | head
total 540
-rw-rw-r-- 1 pamu pamu     39 Nov  6 04:19 Common
-rw-rw-r-- 1 pamu pamu     28 Nov  6 04:19 NFile1
-rw-rw-r-- 1 pamu pamu     30 Nov  6 04:19 NFile2
-rw-rw-r-- 1 pamu pamu     66 Nov  6 04:17 file2
-rw-rw-r-- 1 pamu pamu     60 Nov  6 04:14 file1

Code:
$ cat Common
11    aa   1
12    bb   3
13    cc   4

$ cat NFile1
col1 col2 col3
35    sdf  9

$ cat NFile2
5      ff
Col1 Col2
2      bb

# 12  
Old 11-06-2012
Hi Pamu,

thanks for your reply. but the delimiter in both the files are different file 1 has comma delimter and file 2 has | (pipe) delimiter , Do I need to change the code. please let me know how could I do that.

Thanks for the help . I really appreciate it.


Thanks
Raj
# 13  
Old 11-06-2012
Quote:
Originally Posted by rajeevm
but the delimiter in both the files are different file 1 has comma delimter and file 2 has | (pipe) delimiter , Do I need to change the code. please let me know how could I do that.
try

Code:
awk 'NR==FNR{A[$1]=$0;next}{if(A[$3]){print > "Common";delete A[$3]}else{NF1[$0]=$0}}
END{for(i in A){if(A[i]){print A[i] > "NFile2"}}
for (i in NF1){print i > "NFile1"}}' FS="," file1 FS="|" file2

Last edited by pamu; 11-06-2012 at 08:36 AM..
# 14  
Old 11-06-2012
Here is the sample data in file 2.txt

Code:
123456789|100|1234567890|1|PE|NCY|bcdtxyz|xyzmail@ymail.com|I|2011-04-21|10008mktng59|10008z96n8d3|0BF51A46-68BD-4293-951D-DE08F6381C95|
123456788|100|1234567890|1|PE|NCY|bcdtxyz|xyzmail@ymail.com|I|2011-04-21|10008mktng59|10008z96n8d3|0BF51A46-68BD-4293-951D-DE08F6381C96|
123456787|100|1234567890|1|PE|NCY|bcdtxyz|xyzmail@ymail.com|I|2011-04-21|10008mktng59|10008z96n8d3|0BF51A46-68BD-4293-951D-DE08F6381C97|

File1.txt
Code:
0BF51A46-68BD-4293-951D-DE08F6381C95,500011391,,,,,,,,,,,,,,,500011392,,,,,,,,,,,,,,,500011404,,,,,,,,,,,,,,,500011405,,,,,,,,,,,,,,,500011406,,,,,,,,,,,,,,,500011407,,,,,,,,,,,,,,,500011408,,,,,,,,,,,,,,,000000000,,,,,,,,,,,,,,,10/02/2011
0BF51A46-68BD-4293-951D-DE08F6381C96,500011391,,,,,,,,,,,,,,,500011392,,,,,,,,,,,,,,,500011404,,,,,,,,,,,,,,,500011405,,,,,,,,,,,,,,,500011406,,,,,,,,,,,,,,,500011407,,,,,,,,,,,,,,,500011408,,,,,,,,,,,,,,,000000000,,,,,,,,,,,,,,,10/03/2011
0BF51A46-68BD-4293-951D-DE08F6381C97,500011391,,,,,,,,,,,,,,,500011392,,,,,,,,,,,,,,,500011404,,,,,,,,,,,,,,,500011405,,,,,,,,,,,,,,,500011406,,,,,,,,,,,,,,,500011407,,,,,,,,,,,,,,,500011408,,,,,,,,,,,,,,,000000000,,,,,,,,,,,,,,,10/01/2011

The column which need to compare are highlighted in yellow .

Produce the common records . not in file 1 and not in file 2

Thanks for your help I appreciate it.

Raj
Last edited by Scrutinizer; 11-06-2012 at 10:07 AM.. Reason: code tags
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare files and share output from both files

hi all, Thanks to all for your great help... I have a scenario that I have two files (file1 & file2). I need to compare two files entire row by row and share the output if any discrepancies within two files. File1: DB1|TB1|C1,C3 DB2|TB2|C1,C2 DB3|TB3|C1,C2,C3,C4 File2: ... (2 Replies)
Discussion started by: Selva_2507
2 Replies

2. Shell Programming and Scripting

Compare multiple files, and extract items that are common to ALL files only

I have this code awk 'NR==FNR{a=$1;next} a' file1 file2 which does what I need it to do, but for only two files. I want to make it so that I can have multiple files (for example 30) and the code will return only the items that are in every single one of those files and ignore the ones... (7 Replies)
Discussion started by: castrojc
7 Replies

3. Shell Programming and Scripting

Compare two files, then overwrite first file with only that in both files

I want to compare two files, and search for items that are in both. Then override the first file with that containing only elements which were in both files. I imagine something with diff, but not sure. File 1 One Two Three Four Five File 2 One Three Four Six Eight (2 Replies)
Discussion started by: castrojc
2 Replies

4. Shell Programming and Scripting

Compare files

Please help me with awk.I have two files with the below details file1 123456789 2012 987654321 2011 a1234567892012 a1234abcde2012 b1234567892012 c1234567892012 98765a12342012 file2 a1234 01234 b1234 33333 I need to check whether the items in file2 is present in file1 .If it is... (2 Replies)
Discussion started by: Mary James
2 Replies

5. Shell Programming and Scripting

Require compare command to compare 4 files

I have four files, I need to compare these files together. As such i know "sdiff and comm" commands but these commands compare 2 files together. If I use sdiff command then i have to compare each file with other which will increase the codes. Please suggest if you know some commands whcih can... (6 Replies)
Discussion started by: nehashine
6 Replies

6. Shell Programming and Scripting

Compare 2 folders to find several missing files among huge amounts of files.

Hi, all: I've got two folders, say, "folder1" and "folder2". Under each, there are thousands of files. It's quite obvious that there are some files missing in each. I just would like to find them. I believe this can be done by "diff" command. However, if I change the above question a... (1 Reply)
Discussion started by: jiapei100
1 Replies

7. Shell Programming and Scripting

How to compare 2 files & get only few columns based on a condition related to both files?

Hiiiii friends I have 2 files which contains huge data & few lines of it are as shown below File1: b.dat(which has 21 columns) SSR 1976 8 12 13 10 44.00 39.0700 70.7800 7.0 0 0.00 0 2.78 0.00 0.00 0 0.00 2.78 0 NULL ISC 1976 8 12 22 32 37.39 36.2942 70.7338... (6 Replies)
Discussion started by: reva
6 Replies

8. Shell Programming and Scripting

compare files in two directories and output changed files to third directory

I have searched about 30 threads, a load of Google pages and cannot find what I am looking for. I have some of the parts but not the whole. I cannot seem to get the puzzle fit together. I have three folders, two of which contain different versions of multiple files, dist/file1.php dist/file2.php... (4 Replies)
Discussion started by: bkeep
4 Replies

9. Shell Programming and Scripting

compare two files and to remove the matching lines on both the files

I have two files and need to compare the two files and to remove the matching lines from both the files (4 Replies)
Discussion started by: shellscripter
4 Replies

10. Shell Programming and Scripting

compare two files

I have file1 and file2: file1: 11 xxx kksd ... 22 kkk kdsglg... 33 sss kdfjdksa... 44 kdsf dskjfkas ... hh kdkf kdkkd.. jg dkf dfkdk ... ... file2: jg 22 hh ... I need to check each line of file1. if the field one is in file2, I will keep it; if not, the whole line will be... (17 Replies)
Discussion started by: fredao
17 Replies
Login or Register to Ask a Question