Comparing list of files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Comparing list of files
# 1  
Old 06-29-2013
Comparing list of files

Hi All,

I have a list of files and want to find the difference between each file if there is difference then i want the file name to be printed and log the duplicate files

For example
Code:
Size     Filename
23        a1
23        a2
23        a3
45        a4

If i diff a1 and a2 and find difference then i want the file names to be logged else neglect the file.Even though the sizes are same for a1,a2,a3 i want the file names which is having difference and neglect the files which is having no difference.( In short i want to eliminate duplicate files).
# 2  
Old 06-29-2013
You can run diff on each files, check the exit status and determine if it is different or similar. Here is an example:
Code:
diff a1 a2 > /dev/null

[ $? -ne 0 ] && echo "Different" || echo "Similar"

For diff command, following exit values shall be returned:
Code:
 0 - No differences were found.
 1 - Differences were found.
>1 - An error occurred.

# 3  
Old 06-29-2013
You can omit the test [; use diff's exit code immediately:
Code:
diff a1 a2 > /dev/null && echo identical || echo different

# 4  
Old 06-30-2013
wrong post

---------- Post updated at 01:54 PM ---------- Previous update was at 12:25 PM ----------

can you please provide me in a script as i have thousands of files

Last edited by wedng.bell; 06-30-2013 at 02:34 PM.. Reason: wrong post
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Comparing two files and list the difference with common first line content of both files

I have two file as given below which shows the ACL permissions of each file. I need to compare the source file with target file and list down the difference as specified below in required output. Can someone help me on this ? Source File ************* # file: /local/test_1 # owner: own #... (4 Replies)
Discussion started by: sarathy_a35
4 Replies

2. Shell Programming and Scripting

Comparing two edge list

Hello, I have two network edgelists with first two columns as nodes and the last column pearson correlation coefficient (PCC). I want to remove the edges from net1 whose edges are common with net2 && (PCC)net2>=(PCC)net1 net1.txt A B 0.6 A C 0.7 B C 0.7 D C ... (1 Reply)
Discussion started by: Sanchari
1 Replies

3. Shell Programming and Scripting

Comparing a list of numbers is less than a variable

Hello everyone, I want to compare a list of numbers in the file TEST01 to the variable $Post. Also remove any duplicate numbers. Create an if then statement indicating if the numbers listed in TEST01 is less than the number value of $Post then print an error message. Here is the contents of... (5 Replies)
Discussion started by: seekryts15
5 Replies

4. Shell Programming and Scripting

Comparing list of files in parallel

Hi everyone. I have a list of files like: file001 file002 file003 . . . . file385 file386 file387 There are more files than above, but I hope you understand what I'm trying to do here. Is there a way I can create a loop to compare: file001 with file385 file002 with file386 (9 Replies)
Discussion started by: craigsky
9 Replies

5. UNIX for Dummies Questions & Answers

Comparing lines within a word list

Hello all- New to this forum, and relatively new to using grep at the Terminal command line to work with regular expressions. I've got a background in math and some programming experience, so it's not been too difficult to learn the basics of searching through my word lists for particular types of... (13 Replies)
Discussion started by: dtalvacchio
13 Replies

6. Shell Programming and Scripting

Comparing 2 variable in a list with foreach

cat file1 a b c d e f this is what is in my script foreach i (`cat file1`) foreach j (`cat file1`) #do something here end end basically i want to compare ab, ac, ad, ae, af, ba, bc, bd, be.... and also skipping aa,bb if possible.. if that anyway for me to just use 1 foreach? (2 Replies)
Discussion started by: ctphua
2 Replies

7. Shell Programming and Scripting

Need Help with Bash - comparing directory contents with list of files

Hey guys, need help with a script I'm trying to write. Basically I need to compare the contents of a folder called "profiles" with a list of files called "template". when the file matches the contents of the folder it needs to set a variable called "checked" to "1" Cookies to anyone... (4 Replies)
Discussion started by: Scriporium
4 Replies

8. Shell Programming and Scripting

Comparing two files and list the differences

Hi * I have two text files which has the file size, timestamp and the file name. I need to compare these two files and get the differences in the output format. Can anyone help me out with this. * cat file1.txt *474742 Apr 18* 2010 sample.log *135098 Apr 18* 2010 Testfile 134282 Apr 18* 2010... (7 Replies)
Discussion started by: Sendhil.Kumaran
7 Replies

9. Shell Programming and Scripting

Comparing a distinct value in 1 list with another list

Hi all, I need to compare the contents of 2 directories where the file contents are similar and take out the filenames whose contents does not exist within the 2 directories. Directory1 1 2 3 4 Directory2 54 55 56 57 Does anyone has a script which can do this? At the end of... (6 Replies)
Discussion started by: manualvin
6 Replies

10. UNIX for Dummies Questions & Answers

Comparing data list...

I have a list of files that I want to compare to another list of files, how do I do that? The first list will be my known list and hard coded, for example: mylist="janfile.tar jarfile.jar jan.rpt.Z" etc. The second list will be found by doing an 'ls' piped to a file: ls > filelist.dat ... (4 Replies)
Discussion started by: giannicello
4 Replies
Login or Register to Ask a Question