best method to compare 2 big files in unix

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare and merge two big CSV files

Hi all, i need help. I have two csv files with a huge amount of data. I need the first column of the first file, to be compared with the data of the second, to have at the end a file with the data not present in the second file. Example File1: (only one column) profile_id 57036226...

2. UNIX for Beginners Questions & Answers

Compare two big files for differences using Linux

Hello everybody Looking for help in comparing two files in Linux(files are big 800MB each). Example:- File1 has below data $ cat file1 5,6,3 2.1.4 1,1,1 8,9,1 File2 has below data $ cat file2 5,6,3 8,9,8 1,2,1 2,1,4

3. Shell Programming and Scripting

Compare two big files for differences using Linux

4. Shell Programming and Scripting

Compare two files in UNIX

Hi, I have two files File1 Contents: abc dcf sdc File2 Contents: dcf sdc erg Now my program should return the contents existing in File1 but not in File2. In this case output shoud be "abc" as abc is not available in File 2. It should not return "erg" by saying it is...

5. Shell Programming and Scripting

Compare two files in unix

Hi Gurus I need your kind help sorting the below query I have two text files File1.txt ID Name Address 101 Srinath BBB 102 Sidharth CCC File2.txt ID Name Address 102 Siddharth DDD 103 Suman EEE Now the requirement is if the second file has...

6. UNIX for Advanced & Expert Users

How to compare two files using UNIX?

I have two files which have primary key(s) for each row. I need to compare both the files and produce the output in the following format. Primary key(s),file1 value,file2 value. Both the input files will be comma separated files. I have accomplished this using perl, but it is...

7. UNIX for Dummies Questions & Answers

how can i unix compare two files??

how can i unix compare two files?? var1 = 6499 7328 6351 7583 7573 var2 = 6499 7328 6351 7583 7777 i did: diff $var1 $var2 and i got the output: 1c1 < 6499 7328 6351 7583 7573 --- > 6499 7328 6351 7583 7777 what can i do with it? and what does it tell me?? how can i knoe that...

8. UNIX for Dummies Questions & Answers

Unix Compare Files

Hi, I need to compare 2 files based on the first field in each file and output the differences to a new file. example File 1 and File 2 both have first field as Number ie: File 1 1252652355 1859553322 1778899562 File 2 1252652355 1859553322 So I would expect File 3 to...

9. UNIX for Advanced & Expert Users

UNIX; Compare two files

Hi Guys, Requirement: Want to compare two files, if the the content of both files is same then show "Good result" else Show "Bad Result" I am using the following logic if( cmp -s a b = 0 ) then echo "Good result" else echo "Bad result" exit 0 fi But this is...

10. Shell Programming and Scripting

how to compare big real numbers

Hi everyone, I need to compare 2 big Floating/Real numbers in a script. After the comparission it is showing worng values in my script. echo "Enter value1" read value1 echo "Enter value2" read value2 Result=`echo "if($value1 > $value2) 1" | bc` if ; then echo "$value1 is...

LEARN ABOUT CENTOS

ldns-compare-zones

ldns-compare-zones(1)					      General Commands Manual					     ldns-compare-zones(1)

NAME

       ldns-compare-zones - read and compare two zonefiles and print differences

SYNOPSIS

       ldns-compare-zones [-c] [-i] [-d] [-z] [-s] ZONEFILE1 ZONEFILE2

DESCRIPTION

       ldns-compare-zones reads two DNS zone files and prints number of differences.
       Output is formated to:
	       +NUM_INS        -NUM_DEL        ~NUM_CHG

       The  major  comparison  is  based on the owner name. If an owner name is present in zonefile 1, but not in zonefile 2, the resource records
       with this owner name are considered deleted, and counted as NUM_DEL. If an owner name is present in zonefile 2, but not in zonefile 1,  the
       resource  records with this owner name are considered inserted, and counted as NUM_INS. If an owner name is present in both, but there is a
       difference in the amount or content of the records, these are considered changed, and counted as NUM_CHG.

OPTIONS

       -c     Print resource records whose owner names are in both zone files, but with different resource records. (a.k.a. changed)

       -i     Print resource records whose owner names are present only in ZONEFILE2 (a.k.a. inserted)

       -d     Print resource records whose owner names are present only in ZONEFILE1 (a.k.a. deleted)

       -a     Print all changes. Specifying this option is the same as specifying -c -i amd -d.

       -z     Suppress zone sorting; this option is not recommended; it can cause records to be incorrectly marked as changed,	depending  of  the
	      nature of the changes.

       -s     Do  not  exclude the SOA record from the comparison.  The SOA record may then show up as changed due to a new serial number.  Off by
	      default since you may be interested to know if (other zone apex elements) have changed.

       -h     Show usage and exit

       -v     Show the version and exit

AUTHOR

       Written by Ondej Sury <ondrej@sury.org> for CZ.NIC, z.s.p.o. (czech domain registry)

REPORTING BUGS

       Report bugs to <ondrej@sury.org>.

COPYRIGHT

       Copyright (C) 2005 CZ.NIC, z.s.p.o.. This is free software. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A	PARTICULAR
       PURPOSE.

								    17 Oct 2007 					     ldns-compare-zones(1)

UNIX for Advanced & Expert Users