Compare two files

amir07 · #1 (**permalink**) 10-08-2008

I need to compare two files:
Basically I have an input file fileA.
which need to be compare with fileB located in /etc/lc/mbd directroy

Both file format is like:

abc01def:10.80.11.123

The input file format is:

abc01mns:10.80.11.1
dbc02mns:10.80.11.2
fbc01mns:10.80.11.3
rbc01mns:10.80.11.4
tbc01mps:10.80.11.5
abt05mns:10.80.11.6
zbc11mys:10.80.11.7
ttc01mns:10.80.11.8
hbc05mns:10.80.11.9
qbc01mns:10.80.11.10

So after comparison the script will tell me:
what has been dupicate and what not duplicate.

Thanks

joeyg · #2 (**permalink**) 10-08-2008

My preference is the comm command. From the manpages --

Code:

OPTIONS
     The following options are supported:

     -1       Suppresses the output column  of  lines  unique  to
              file1.

     -2       Suppresses the output column  of  lines  unique  to
              file2.

     -3       Suppresses the output column of lines duplicated in
              file1 and file2.

If you provide samples of both files, an example command could be created.

amir07 · #3 (**permalink**) 10-08-2008

Thanks.,

This approach works, what do you think:

#!/bin/ksh
while read myline
do
cnt=0
while read line
do
if [[ "$myline" = "$line" ]]
then
((cnt+=1))
break
fi
done < file1
if [[ $cnt -eq 0 ]]
then
echo "$myline" >> output.file
fi
done < file2

amir07 · #4 (**permalink**) 10-08-2008

But the problem here is suppose if i have one additional line in any file, it does not compare. It compares only with exact line numbers in each file.

matrixmadhan · #5 (**permalink**) 10-08-2008

you can try something like,

[ not tested ]

Code:

awk 'BEGIN{ while ( getline < "file_1" ) { arr[$0]++ } }{ if ( $0 in arr ) { printf "%s is duplicate\n", $0 } }' file_2

treesloth · #6 (**permalink**) 10-08-2008

The diff command seems ideal for this. In particular:

Code:

diff -y file1 file2

This will give a side-by-side comparison. The man page lists more options than I've ever dreamed of using, but -y seems to answer your needs.

Franklin52 · #7 (**permalink**) 10-09-2008

Try this, the result is stored in the files dup_file and no_dup_file:

Code:

awk 'NR==FNR{a[$0]=$0;next}
$0 in a {print $0 > "dup_file";next}
{print $0 > "no_dup_file"}
' fileA fileB

Use nawk or /usr/xpg4/bin/awk on Solaris.

Regards

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
compare files	prashanth.spl	Shell Programming and Scripting	0	06-18-2008 04:22 PM
compare files	danabo	Shell Programming and Scripting	3	05-19-2008 12:09 PM
compare two files	charandevu	Shell Programming and Scripting	7	03-30-2008 03:20 PM
Compare two files	penfold	Shell Programming and Scripting	3	04-28-2005 11:04 PM
compare files and beyond	MizzGail	UNIX for Dummies Questions & Answers	2	04-25-2003 01:34 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread: