output difference in two files


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers output difference in two files
# 1  
Old 07-13-2008
output difference in two files

Hi,

Please help me, I have two files. I need to output the difference of contents of each file in another file. For example, I need to know the content of the file1 that does not exist on file2 and vice versa. Please take note that the size of the files are large. How can I do it using unix command or a unix script? Thanks in advance!

HTML Code:
file1:
21399,60459
21389,60589
21365,60298
21397,60287
21377,60812

file2:
21365,60298
21320,60100
21389,60589
21308,60611
21321,60432

output:
file1                       file2
21320,60100           21399,60459
21308,60611           21397,60287
21321,60432           21377,60812
# 2  
Old 07-13-2008
You can do something like this:

Code:
#!/bin/sh

rm diff1 diff2

while read line; do
  grep "$line" file2 > /dev/null 2>&1
  case $? in
     1) echo "$line" >> diff1 ;;
  esac
done < file1

while read line; do
  grep "$line" file1 > /dev/null 2>&1
  case $? in
     1) echo "$line" >> diff2 ;;
  esac
done < file2

Or:

Code:
diff file1 file2|awk '/^</{print $2 > diff1}/^>/{print $2 > diff2}'

The differences are in the files diff1 and diff2.

Regards
# 3  
Old 07-14-2008
If your shell supports process substitution:
(use nawk or /usr/xpg4/bin/awk on Solaris)

Code:
paste <(awk 'NR==FNR{f1[$0];next}!($0 in f1)' file1 file2) \
<(awk 'NR==FNR{f2[$0];next}!($0 in f2)' file2 file1)

# 4  
Old 07-16-2008
man comm
# 5  
Old 07-16-2008
csh:
a simple "diff file1 file2 > file3" would do.

Differences will be in file3 with arrows pointing to which file difference was found.

example:

% diff awe_parse AWE_parse
17,20c17
< echo "Parsing: ${AWEDIR}/${FILE} file"
<
< sed -e 's/[0-9]TRUE/ TRUE/g' -e 's/[0-9]FALSE/ FALSE/g' ${AWEDIR}/${FILE} > ${AWEDIR}/${NEWFILE}
<
---
> echo "AWE file: ${AWEDIR}/${FILE} found"
%

Some contents were found in first file that are not in 2nd file. Same for 2nd file.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Difference output of files

Need help on below req Compare two files and send difference of file to other file File2 is static which never changes ex: File1 A.txt B.ttx C.txt E.txt File2 A.txt (6 Replies)
Discussion started by: satish1222
6 Replies

2. Shell Programming and Scripting

Script to compare 2 files and prints difference as output sidebyside

Hi All, Am trying script to compare 2 files and print the difference found from old file to new file on line by line basis on side by side display. Basically line by line comparision and files may contain blank line as well I know we have compare/diff commands but i don't how to make... (10 Replies)
Discussion started by: Optimus81
10 Replies

3. Shell Programming and Scripting

Compare two text files and output difference

Hi experts, I am trying to compare two text files and output the difference to another file. I'm not strictly looking for differences in text but additional text at the end of one file that isn't in another, so basically comparing the file 2 against file 1 and printing any additional text to... (9 Replies)
Discussion started by: martin0852
9 Replies

4. Shell Programming and Scripting

Comparing text in 2 files and output difference in another file.

I have 2 files of almost same text apart from 2,3 ending lines. Now I want to get that difference in another file. e.g file1.txt is Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_livecd-lv_root 18G 2.4G 15G 14% / tmpfs 504M ... (12 Replies)
Discussion started by: kashif.live
12 Replies

5. Shell Programming and Scripting

Compare two files and output difference, by first field using awk.

It seems like a common task, but I haven't been able to find the solution. vitallog.txt 1310,John,Hancock 13211,Steven,Mills 122,Jane,Doe 138,Thoms,Doe 1500,Micheal,May vitalinfo.txt 12122,Jane,Thomas 122,Janes,Does 123,Paul,Kite **OUTPUT** vitalfiltered.txt 12122,Jane,Thomas... (2 Replies)
Discussion started by: charles33
2 Replies

6. Shell Programming and Scripting

How to combine 2 files and output the unique & difference?

Hi Guys, I have two input files and I want to combine them and get the unique values and differences and put them into one file. See below desired output file. Inputfile1: 1111111 2222222 3333333 7860068 7860069 7860071 7860072 Inputfile2: 4444444 (4 Replies)
Discussion started by: pinpe
4 Replies

7. Solaris

Difference in date output

HiCan anyone tell me why I am getting a difference in the date format on 2 different Solaris servers?On one I get: -Monday, 9 November 2009 09:02:45 GMTand the other: -Monday November 9 09:03:05 GMT 2009Both servers are running OS Version M-11/16/88iCan anyone tell me why one uses a "," and the... (5 Replies)
Discussion started by: steadyonabix
5 Replies

8. HP-UX

Difference in netstat -a and -an output.

Hi, Does anyone know why I get a different output when using "netstat -a" or "netstat -an" ?? # netstat -a | grep ts15r135 tcp 0 0 nbsol152.62736 ts15r135.23211 ESTABLISHED # netstat -an | grep 172.23.160.78 tcp 0 0 135.246.39.152.51954 ... (4 Replies)
Discussion started by: ejdv
4 Replies

9. UNIX for Dummies Questions & Answers

Compare Files and Output Difference

I have to compare two files for any differences, then output the lab and question number for any differences. This is what I currently have: diff lab2.txt lab2answer.txt > lab2compare.txt Though the output doesn't have to be sent to a .txt (or any sort of log), I found that easier, at least... (2 Replies)
Discussion started by: Joesgrrrl
2 Replies

10. UNIX for Dummies Questions & Answers

How to output the difference of two files?

Hi, I had two data file (File1, File2), each one just have one column, but two file were very big. File2 is smaller, all its data included in File1. I want to ouput the result which don't have any data in File2. Could any one give me a help on how to do that? Thanks in advance! Yun ... (4 Replies)
Discussion started by: yxiao
4 Replies
Login or Register to Ask a Question