Comparison of 2 files in UNIX


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Comparison of 2 files in UNIX
# 15  
Old 11-12-2007
Quote:
Originally Posted by Dana Evans
for eg there are two files to be compared
file1
1111 | universe
2222 |good
3333 |good
4444 |good



file2
1111 | universe
3333 |universe
2222 |good
4444 |good
Just to verify, your two files will always have the same number of lines? If not, there is no way to make the comparison.
# 16  
Old 11-12-2007
Hi.
Quote:
Originally Posted by kahuna
Just to verify, your two files will always have the same number of lines? If not, there is no way to make the comparison.
My impression is that this is a row-to-row comparison, so that if you run out of rows (lines) on either file prematurely, you just stop. It's not like diff, where one seeks back and forth vertically to see what was added, deleted, or changed.

Do you see it differently? [pun intended] ... cheers, drl

Last edited by drl; 11-12-2007 at 08:04 PM..
# 17  
Old 11-12-2007
Quote:
Originally Posted by drl
Do you see it differently? [pun intended] ... cheers, drl
Smilie
I'm just trying to verify that the original poster has thought the problem through. Your code will work correctly for the stated problem. But, if there are additions or deletions along with his updates, and the additions are not at the end of the file2, then he's back to a manual process of trying to figure out what changed between the files. In most situations, there is a key field to match on. But that doesn't seem to be the case here.
# 18  
Old 11-12-2007
Question

hey DRL thanks a ton!! for your help ..
but again as per the requirement of boss it has to be done using Unix shell script ( plsql if required)Smilie

the files file1 and file2 won't necessarily have the same number of rows .
file1 and file2 have column values of a specific oracle table exported and stored in Unix system on regular basis .
the idea is two compare the contents of the files of previous day and current day ( for e.g file1 is previous day's file and file2 is current day's file) i.e. we got to do row wise comparison of file and detect if there is change in any particular row value if any particular row in file2 (say for e.g row number 3 ) differs from row number 3 of file1 ... then the script should pick up the row num 3 value from file 2 and re-direct it to another third file.

but since we got to verify previous day's and current day's records .. so even if both the files do not have same number of lines ... it won't be a problem as our target is to compare whether a particular row which had some value until yesterday still has the same value today or has it been changed.. in such case the script can compare until it reaches the row end of file1 .
hope i m clear with my question

Last edited by Dana Evans; 11-12-2007 at 11:54 PM..
# 19  
Old 11-13-2007
well i came across options ( thanks to this forum) but following code i tried
comp1=$(cat file1 | cut -d"|" -f1,2)
comp2=$(cat file2 | cut -d"|" -f1,2)
for str in ${comp2[*]}
do
count=0
while (( $count < ${#comp1[*]} ))
do
if [[ $str != ${comp1[count]} ]]
then

cat file2 | grep $str >> find.txt
fi
count=`expr $count+1`
done
done


Note:
file1
1111|universe
2222|good
3333|good
4444|good


file2
1111|universe
3333|universe
2222|good
4444|good


and in output i should get


3333|universe
2222|good


as row 2 and 3 of file2 are different from file1 so these 2 lines would be picked up from file2

i am not getting desired result
any suggestion how can the code be modified

Smilie

Last edited by Dana Evans; 11-13-2007 at 04:53 AM..
# 20  
Old 11-13-2007
try this,

Code:
perl -e ' open(FILE, "<", "f1"); while(<FILE>) { $fileHash{$_} = $. ; } close(FILE); open(FILE, "<", "f2"); while(<FILE>) { print $_ if ( $fileHash{$_} != $. ); } close(FILE); '

# 21  
Old 11-13-2007
You didn't tell us which shell you are using. I don't know if your construction works in bash, but in ksh it won't:

typeset -A comp1=$(cat file1 | cut -d"|" -f2)

will produce an array with exactly one element from your files, as "typeset -A" uses whitespace as delimiter, not newlines. You will see that when you trace the script with "set -xv" and watch the output of "(cat file1 | cut ...)".

Then there is a logical error in your code: the "for str in .... done" cycles through every element of the array comp2[]. You compare each to every element of comp1[]: comp2[1] to comp1[1], then comp2[1] to comp1[2], ..., comp2[1] to comp1[n], comp2[2] to comp1[1], comp2[2] to comp1[2], ... This is probably not what you want to achieve - you want to compare comp1[1] to comp2[1], comp1[2] to comp2[2], etc. This is done by the following (demo-)code:

Code:
(( count = 0 ))
while (( count < ${#comp2[*]} )) ; do
     if [ "${comp2[$count]}" != "${comp1[$count]}" ] ; then
          print - "line $count is different"
     else
          print - "line $count is equal"
     fi
     (( count += 1 ))
done

If you want to *search* in one file for the key you found in the other and don't rely on them being sorted according to the same key then do the following: cycle through one array, searching through the other one. If you find a corresponding value store the number of the array-element found. If this number is not stored you have not found a corresponding element. Again, in a sketchy demo-code:

Code:
(( count1 = 0 ))
(( count2 = 0 ))
(( found = -1 ))
while (( count2 < ${#comp2[*]} )) ; do
     (( count1 = 0 ))
     (( found = -1 ))
     while (( count1 < ${#comp1[*]} )) ; do
          if [ "${comp2[$count2]}" != "${comp1[$count1]}" ] ; then
               (( found = count1 ))
          fi
          (( count1 += 1 ))
     done
     if [[ $found -lt 0 ]] ; then
          print - "no corresponding element to ${comp2[$count2]} found"
     else
          print - "element ${comp2[$count2]} corresponds to ${comp1[$found]}"
     fi
     (( count2 += 1 ))
done


bakunin
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Comparison of files

I have the requirement I have two files cat fileA something anythg nothing everythg cat fileB everythg anythg Now i shld use fileB and compare every line at fileA and get the output as something nothing (3 Replies)
Discussion started by: Priya Amaresh
3 Replies

2. Shell Programming and Scripting

UNIX file comparison

I have two files which has component name and version number separated by a space cat file1 com.acc.invm:FNS_PROD 94.0.5 com.acc.invm:FNS_TEST_DCCC_Mangment 94.1.6 com.acc.invm:FNS_APIPlat_BDMap 100.0.9 com.acc.invm:SendEmail 29.6.113 com.acc.invm:SendSms 12.23.65 cat file2 ... (8 Replies)
Discussion started by: rakeshtomar82
8 Replies

3. Shell Programming and Scripting

Need help regarding comparison between two files through UNIX script

Hi All , I am aware of unix command ,but not comforable in putting together in script level.I came to situation where I need to compare between two .txt files fieldwise and need a mismatch report. As I am new to unix script arena ,if anyone can help in the below scenario that will be really... (9 Replies)
Discussion started by: STCET22
9 Replies

4. Shell Programming and Scripting

Comparison between two files through UNIX script

Hi All , As I am new to unix scripting ,I need a help regarding unix scripting .I have two .txt files .One is source file and another is target file.I need a script through which I can compare those two files.I need a automated comparison report in a directory after comparing between source &... (2 Replies)
Discussion started by: STCET22
2 Replies

5. Shell Programming and Scripting

File comparison in UNIX columnwise

Hi all, I want to compare two files with same number of rows and columns with records in same order. Just want to highlight the differences in the column values if any. file A 1,kolkata,19,ab 2,delhi,89,cd 3,bangalore,56,ef file2: 1,kolkata,21,ab 2,mumbai,89,gh 3,bangalore,11,kl... (9 Replies)
Discussion started by: prabhat.diwaker
9 Replies

6. Shell Programming and Scripting

Comparison of two files

Hi all I have two files which I have to compare that whetehr there is soemthing common or not body, div, table, thead, tbody, tfoot, tr, th, td, p { font-family: "Liberation Sans"; font-size: x-small; } body, div, table, thead, tbody, tfoot,... (2 Replies)
Discussion started by: manigrover
2 Replies

7. Shell Programming and Scripting

comparison of 2 files using unix or awk

Hello, I have 2 files and I want them to be compared in a specific fashion file1: A_1200_1250 A_1251_1300 B_1301_1350 B_1351_1400 B_1401_1450 C_1451_1500 and so on... file2: 1210 1305 1260 1295 1400 1500 1450 1495 Now The script should look for "1200" from A_1200_1250 of... (8 Replies)
Discussion started by: Diya123
8 Replies

8. Shell Programming and Scripting

Comparison of two files (sh)

Hi, I have a problem with comparison of two files file1 20100101 20090101 20080101 20071001 20121229 file2 19990112 12 456 7 20011131 19 20100101 2 567 1 987 17890709 123 555 and, sh script needs to compare of these two files and give out to me result: 20100101 2 567 1 987 it... (5 Replies)
Discussion started by: shizik
5 Replies

9. Shell Programming and Scripting

comparison of 2 files

Kindly help on follows. I have 2 files. One file contains only one column of mobile numbers. And total records in a file 12 million. Second file contains 2 columns mobile numbers and balance. and total records 30 million. I want to find out balance of each data in file 1 corresponding to file 2.... (2 Replies)
Discussion started by: kamal_418
2 Replies

10. UNIX for Dummies Questions & Answers

Unix comparison

I am very new to Unix. What are the similiarities and differences between ScoUnix and AIX5 if any? Where might i find the information? Which is better? (1 Reply)
Discussion started by: NewGuy100
1 Replies
Login or Register to Ask a Question