Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Comparing files
Top Forums Shell Programming and Scripting Comparing files Post 302343021 by necroman08 on Tuesday 11th of August 2009 10:24:47 AM
Old 08-11-2009
Quote:
Originally Posted by aigles
Optimize a little bit your script
Code:
#!/bin/bash
while read l1 n1 filler
do
   n2=$(awk "/^$l1/ { print \$2 }" File2)
   echo $l1 $((n2-n1))
done < File1

The technique used in your solution is not performant for large files, File2 is opened and read for each record of File1.

Jean-Pierre.
Yep, your right, itīs a little bit terrible.
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

comparing shadow files with real files

Hi I need to compare shadow file sizes with their real file counterparts. If the shadow file size differs form the realfile size then it must send a mail. My problem is that our system has over 1600 shadowfiles in different directories, with different names. the only consistancy is the .sh file... (4 Replies)
Discussion started by: terrym
4 Replies

2. Shell Programming and Scripting

Comparing files

I have a file called X, which contains the following: 10 100 200 300 I then have file Y, which containts the following: 10 200 500 800 I want to write a script that will compare the contents of Y with the contents of X and ONLY return values in Y that does not exist in X (output... (5 Replies)
Discussion started by: soliberus
5 Replies

3. Shell Programming and Scripting

Need Help Comparing two Files

I really need help on creating a script that does the following: I have one file (File 1) with lines in the following format: Name.maf score1 score2 I have a second file (File 2) with lines in the following format: label start end Name What I need to do is compare File 1 and... (1 Reply)
Discussion started by: awknerd
1 Replies

4. Shell Programming and Scripting

Need help comparing two files and deleting some things in those files!

So I have two files: File1 pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2 pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2 ref4948 1.1 treehouse.txt 1.6 ref8573 1.5 ref3284 1.4 ref5838... (24 Replies)
Discussion started by: linuxkid
24 Replies

5. Shell Programming and Scripting

Comparing the matches in two files using awk when both files have their own field separators

I've two files with data like below: file1.txt: AAA,Apples,123 BBB,Bananas,124 CCC,Carrot,125 file2.txt: Store1|AAA|123|11 Store2|BBB|124|23 Store3|CCC|125|57 Store4|DDD|126|38 So,the field separator in file1.txt is a comma and in file2.txt,it is | Now,the output should be... (2 Replies)
Discussion started by: asyed
2 Replies

6. UNIX for Advanced & Expert Users

How to find duplicates contents in a files by comparing other files?

Hi Guys , we have one directory ...in that directory all files will be set on each day.. files must have header ,contents ,footer.. i wants to compare the header,contents,footer ..if its same means display an error message as 'files contents same' (7 Replies)
Discussion started by: Venkatesh1
7 Replies

7. Shell Programming and Scripting

Help with comparing two files

Hi all I have to compare two file this time one is P11223 x1124 x1145 t5678 e3456 z2345 another file P11223 x s (2 Replies)
Discussion started by: manigrover
2 Replies

8. Shell Programming and Scripting

Comparing the files

Hi Friends, I have file1.txt file2.txt I tried using the diff and comm but not getting the expected output.. I want where exactly the miss match occurs. probably the field. Sourcevalue|Targetvalue|Linenumber|field 29123975|2923975|3|1 Please help. (6 Replies)
Discussion started by: i150371485
6 Replies

9. Shell Programming and Scripting

Comparing files in a directory against an array of files

I hope I can explain this correctly. I am using Bash-4.2 for my shell. I have a group of file names held in an array. I want to compare the names in this array against the names of files currently present in a directory. If the file does not exist in the directory, that is not a problem.... (5 Replies)
Discussion started by: BudMan
5 Replies

10. UNIX for Beginners Questions & Answers

Comparing two files and list the difference with common first line content of both files

I have two file as given below which shows the ACL permissions of each file. I need to compare the source file with target file and list down the difference as specified below in required output. Can someone help me on this ? Source File ************* # file: /local/test_1 # owner: own #... (4 Replies)
Discussion started by: sarathy_a35
4 Replies

LEARN ABOUT CENTOS

tiffcmp

TIFFCMP(1)						      General Commands Manual							TIFFCMP(1)

NAME

       tiffcmp - compare two TIFF files

SYNOPSIS

       tiffcmp [ options ] file1.tif file2.tif

DESCRIPTION

       Tiffcmp compares the tags and data in two files created according to the Tagged Image File Format, Revision 6.0.  The schemes used for com-
       pressing data in each file are immaterial when data are compared-data are compared on a	scanline-by-scanline  basis  after  decompression.
       Most  directory	tags are checked; notable exceptions are: GrayResponseCurve, ColorResponseCurve, and ColorMap tags.  Data will not be com-
       pared if any of the BitsPerSample, SamplesPerPixel, or ImageWidth values are not equal.	By default, tiffcmp will terminate if  it  encoun-
       ters any difference.

OPTIONS

       -l     List each byte of image data that differs between the files.

       -z number
	      List specified number of image data bytes that differs between the files.

       -t     Ignore any differences in directory tags.

BUGS

       Tags that are not recognized by the library are not compared; they may also generate spurious diagnostics.

       The image data of tiled files is not compared, since the TIFFReadScanline() function is used.  An error will be reported for tiled files.

       The pixel and/or sample number reported in differences may be off in some exotic cases.

SEE ALSO

       pal2rgb(1), tiffinfo(1), tiffcp(1), tiffmedian(1), libtiff(3TIFF)

       Libtiff library home page: http://www.remotesensing.org/libtiff/

libtiff 							 November 2, 2005							TIFFCMP(1)
All times are GMT -4. The time now is 06:22 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy