02-19-2010
If the files are normally the same I'd run the checksum program "cksum" on each file first and compare the results. This is the quickest way to prove whether two files are identical.
If they are not identical then actually run a command to compare them.
Whether you can use any standard unix commands to compare files which are larger than 2Gb depends on your Operating System and version.
We seem to be assuming that these are unix standard text files. Are they text files? If not, what software was used to create the files?
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I have a file {filename} which contains 65000 records
I need to split into 6 smaller files roughly 11000 records each.
Can someone advise me of the Unix command to do so ?
Many thanks (2 Replies)
Discussion started by: grinder182533
2 Replies
2. Solaris
Hi,
I have files with records of 40,00,000& 39,00,000 and i want to find out the
content
1.which is existing in file1 and not in file2.
2.Which is exisitng in file2 and not in file1.
The format of the file will be like
404ABCDEFGHIJK|CDEFGHIJK|1234567890|1
If its a smaller one i... (1 Reply)
Discussion started by: salaathi
1 Replies
3. Shell Programming and Scripting
Hi All
I am sorting a huge file
-rw-r--r-- 1 rama users 448156978 May 13 18:48 102384.temp
$ sort -k 1,40n 102384.temp > 102384.temp1
msgcnt 1468 vxfs: mesg 001: vx_nospace - /dev/vg00/var file system full (1 block extent)
sort: A write error occurred while sorting.
I thought... (3 Replies)
Discussion started by: dhanamurthy
3 Replies
4. Shell Programming and Scripting
I have a file with data extracted, and need to insert a header with a constant string, say: H|PayerDataExtract
if i use sed, i have to redirect the output to a seperate file like
sed ' sed commands' ExtractDataFile.dat > ExtractDataFileWithHeader.dat
the same is true for awk
and... (10 Replies)
Discussion started by: deepaktanna
10 Replies
5. Shell Programming and Scripting
Hi ,
i have files coming in my system which are very huge in MB and GBs, all these files are in a single line, there is no newline character.
I need to get only last 700 bytes of these files, of this i am splitting the files by "split -b 700 filename" but this gives all the splitted... (2 Replies)
Discussion started by: Prateek007
2 Replies
6. Shell Programming and Scripting
I got three different file:
Part of File 1
ARTPHDFGAA
.
.
Part of File 2
ARTGHHYESA
.
.
Part of File 3
ARTPOLYWEA
.
. (4 Replies)
Discussion started by: patrick87
4 Replies
7. Shell Programming and Scripting
Hi Experts,
I had to edit (a particular value) in header line of a very huge file so for that i wanted to search & replace a particular value on a file which was of 24 GB in Size. I managed to do it but it took long time to complete. Can anyone please tell me how can we do it in a optimised... (7 Replies)
Discussion started by: manishkomar007
7 Replies
8. UNIX for Dummies Questions & Answers
Hi all,
I hope you are well. I am very happy to see your contribution. I am eager to become part of it.
I have the following question. I have two huge files to compare (almost 3GB each). The files are simulation outputs. The format of the files are as below
For clear picture, please see... (9 Replies)
Discussion started by: kaaliakahn
9 Replies
9. UNIX for Dummies Questions & Answers
Please help. My file system is 100%, I can't seem to find what is taking so much space. The total hard drive space is 150Gig free but I got nothing now.
I did to this to find the big file but it's taking so much time. Is there any other way?
du -ah / | more
find ./ -size +200M... (3 Replies)
Discussion started by: samnyc
3 Replies
10. Solaris
Gents
I have huge NAS File System as /sys with size 10 TB and I want to Split each 1TB in spirit File System to be mounted in the server.
How to can I do that without changing anything in the source.
Please your support. (1 Reply)
Discussion started by: AbuAliiiiiiiiii
1 Replies
cmp(1) General Commands Manual cmp(1)
NAME
cmp - Compares two files
SYNOPSIS
cmp [-l | -s] file1 file2
STANDARDS
Interfaces documented on this reference page conform to industry standards as follows:
cmp:XCU5.0
Refer to the standards(5) reference page for more information about industry standards and associated tags.
OPTIONS
Prints the byte number (decimal) and the differing bytes (octal) for each difference. Does not print data for differing files; returns
only an exit value.
OPERANDS
The path name of a file to be compared. The path name of a file to be compared.
DESCRIPTION
The cmp command compares two files.
If file1 or file2 is - (dash), standard input is used for that file. It is an error to specify - for both files.
By default, the cmp command prints no information if the files are the same. If the files differ, cmp prints the byte and line number
where the difference occurred.
The cmp command also specifies whether one file is an initial subsequence of the other (that is, if the cmp command reads an End-of-File
character in one file before finding any differences). Usually, you use the cmp command to compare nontext files and the diff command to
compare text files.
Note that bytes and lines reported by cmp are numbered from 1.
EXIT STATUS
The following exit values are returned: The files are identical. The files differ. This includes files of different lengths that are
identical in the first part of both files. An error occurred.
EXAMPLES
To determine whether two files are identical, enter: cmp prog.o.bak prog.o
The preceding command compares the files prog.o.bak and prog.o. If the files are identical, a message is not displayed. If the
files differ, the location of the first difference is displayed. For instance: prog.o.bak prog.o differ: byte 5, line 1
If the message cmp: EOF on prog.o.bak is displayed, then the first part of prog.o is identical to prog.o.bak, but there is addi-
tional data in prog.o.
If the message cmp: EOF on prog.o is displayed, it is prog.o.bak that is the same as prog.o but also contains addition data. To
display each pair of bytes that differ, enter: cmp -l prog.o.bak prog.o
This compares the files and then displays the byte number (in decimal) and the differing bytes (in octal) for each difference. For
example, if the fifth byte is octal 101 in prog.o.bak and 141 in prog.o, then the cmp command displays: 5 101 141
.
.
.
ENVIRONMENT VARIABLES
The following environment variables affect the execution of cmp: Provides a default value for the internationalization variables that are
unset or null. If LANG is unset or null, the corresponding value from the default locale is used. If any of the internationalization vari-
ables contain an invalid setting, the utility behaves as if none of the variables had been defined. If set to a non-empty string value,
overrides the values of all the other internationalization variables. Determines the locale for the interpretation of sequences of bytes
of text data as characters (for example, single-byte as opposed to multibyte characters in arguments). Determines the locale for the for-
mat and contents of diagnostic messages written to standard error. Determines the location of message catalogues for the processing of
LC_MESSAGES.
SEE ALSO
Commands: comm(1), bdiff(1), diff(1), diff3(1), sdiff(1)
Standards: standards(5)
cmp(1)