Sponsored Content
Top Forums UNIX for Dummies Questions & Answers Difference between two huge files Post 302235855 by pyaranoid on Saturday 13th of September 2008 10:14:56 AM
Old 09-13-2008
Any Auggestions Please?

Thanks

Sue
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Comparing two huge files

Hi, I have two files file A and File B. File A is a error file and File B is source file. In the error file. First line is the actual error and second line gives the information about the record (client ID) that throws error. I need to compare the first field (which doesnt start with '//') of... (11 Replies)
Discussion started by: kmkbuddy_1983
11 Replies

2. AIX

Huge difference in reported Disk usage between ls,df and du

IBM RS6000 F50 AIX 4.3.2 i am having trouble in calculating the actual size of a set of directories and reconciling the results with the actual Hard Disk space used I have 33GB disk which is showing 7.8GB used, a byte count of the files in the directory/sub-dirs i`m interested in is 48GB,... (4 Replies)
Discussion started by: cooperuf
4 Replies

3. UNIX for Advanced & Expert Users

Huge files manipulation

Hi , i need a fast way to delete duplicates entrys from very huge files ( >2 Gbs ) , these files are in plain text. I tried all the usual methods ( awk / sort /uniq / sed /grep .. ) but it always ended with the same result (memory core dump) In using HP-UX large servers. Any advice will... (8 Replies)
Discussion started by: Klashxx
8 Replies

4. High Performance Computing

Huge Files to be Joined on Ux instead of ORACLE

we have one file (11 Million) line that is being matched with (10 Billion) line. the proof of concept we are trying , is to join them on Unix : All files are delimited and they have composite keys.. could unix be faster than Oracle in This regards.. Please advice (1 Reply)
Discussion started by: magedfawzy
1 Replies

5. Shell Programming and Scripting

Replacing second line from huge files

I'm trying simple functionality of replacing the second line of files with some other string. Problem is these files are huge and there are too many files to process. Could anyone please suggest me a way to replace the second line of all files with another text in a fastest possible manner. ... (2 Replies)
Discussion started by: satish.pyboyina
2 Replies

6. Programming

Huge difference between _POSIX_OPEN_MAX and sysconf(_SC_OPEN_MAX).

On my Linux system there seems to be a massive difference between the value of _POSIX_OPEN_MAX and what sysconf(_SC_OPEN_MAX) returns and also what I'd expect from the table of examples of configuration limits from Advanced Programming In The UNIX Environment, 2nd Ed. _POSIX_OPEN_MAX: 16... (5 Replies)
Discussion started by: gencon
5 Replies

7. Shell Programming and Scripting

Compare 2 folders to find several missing files among huge amounts of files.

Hi, all: I've got two folders, say, "folder1" and "folder2". Under each, there are thousands of files. It's quite obvious that there are some files missing in each. I just would like to find them. I believe this can be done by "diff" command. However, if I change the above question a... (1 Reply)
Discussion started by: jiapei100
1 Replies

8. Shell Programming and Scripting

Three Difference File Huge Data Comparison Problem.

I got three different file: Part of File 1 ARTPHDFGAA . . Part of File 2 ARTGHHYESA . . Part of File 3 ARTPOLYWEA . . (4 Replies)
Discussion started by: patrick87
4 Replies

9. Shell Programming and Scripting

Difference between two huge .csv files

Hi all, I need help on getting difference between 2 .csv files. I have 2 large . csv files which has equal number of columns. I nned to compare them and get output in new file which will have difference olny. E.g. File1.csv Name, Date, age,number Sakshi, 16-12-2011, 22, 56 Akash,... (10 Replies)
Discussion started by: Dimple
10 Replies

10. Shell Programming and Scripting

Aggregation of Huge files

Hi Friends !! I am facing a hash total issue while performing over a set of files of huge volume: Command used: tail -n +2 <File_Name> |nawk -F"|" -v '%.2f' qq='"' '{gsub(qq,"");sa+=($156<0)?-$156:$156}END{print sa}' OFMT='%.5f' Pipe delimited file and 156 column is for hash totalling.... (14 Replies)
Discussion started by: Ravichander
14 Replies
IDIFF(1)                                                      General Commands Manual                                                     IDIFF(1)

NAME
idiff - compare two images SYNOPSIS
idiff [options] image1 image2 DESCRIPTION
The idiff utility is invoked as follows: idiff [options] image1 image2 Where input1 and input2 are the names of two image files that should be compared. They may be of any format recognized by OpenImageIO (i.e., for which image-reading plugins are available). If the two input images are not the same resolutions, or do not have the same number of channels, the comparison will return FAILURE imme- diately and will not attempt to compare the pixels of the two images. If they are the same dimensions, the pixels of the two images will be compared, and a report will be printed including the mean and maximum error, how many pixels were above the warning and failure thresholds, and whether the result is PASS, WARNING, or FAILURE. For example: $ idiff a.jpg b.jpg Comparing "a.jpg" and "b.jpg" Mean error = 0.00450079 RMS error = 0.00764215 Peak SNR = 42.3357 Max error = 0.254902 @ (700, 222, B) 574062 pixels (82.1%) over 1e-06 574062 pixels (82.1%) over 1e-06 FAILURE The "mean error" is the average difference (per channel, per pixel). The "max error" is the largest difference in any pixel channel, and will point out on which pixel and channel it was found. It will also give a count of how many pixels were above the warning and failure thresholds. The metadata of the two images (e.g., the comments) are not currently compared; only differences in pixel values are taken into considera- tion. For a complete description, see /usr/share/doc/libopenimageio-dev/openimageio.pdf.gz. OPTIONS
--help Print help message -v Verbose status messages -a Compare all subimages/miplevels Thresholding and comparison options -fail %g Failure threshold difference (0.000001) -failpercent %g Allow this percentage of failures (0) -hardfail %g Fail if any one pixel exceeds this error (infinity) -warn %g Warning threshold difference (0.00001) -warnpercent %g Allow this percentage of warnings (0) -hardwarn %g Warn if any one pixel exceeds this error (infinity) -p Perform perceptual (rather than numeric) comparison Difference image options -o %s Output difference image -od Output image only if nonzero difference -abs Output image of absolute value, not signed difference -scale %g Scale the output image by this factor SEE ALSO
iconvert(1), igrep(1), iinfo(1), iprocess(1), iv(1), maketx(1), oiiotool(1). AUTHOR
OpenImageIO was written by Larry Gritz and the other authors and contributors. This manual page was written by IRIE Shinsuke <irieshinsuke@yahoo.co.jp>, for the Debian project (and may be used by others). May 19, 2012 IDIFF(1)
All times are GMT -4. The time now is 11:22 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy