How to find duplicates contents in a files by comparing other files?

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Find a list of files in directory, move to new, allow duplicates

Greetings. I know enough Unix to be dangerous (!) and know that there is a clever way to do the following and it will save me about a day of agony (this time) and I will use it forever after! (many days of agony saved in the future)! Basically I need to find any image files (JPGs, PSDs etc)...

2. Shell Programming and Scripting

Need Help with Bash - comparing directory contents with list of files

Hey guys, need help with a script I'm trying to write. Basically I need to compare the contents of a folder called "profiles" with a list of files called "template". when the file matches the contents of the folder it needs to set a variable called "checked" to "1" Cookies to anyone...

3. Shell Programming and Scripting

how to check the duplicates files contents

Hi all , am using unix aix .. how to check the duplicates files contents and moving to someother folders ex .. i have files called qqq cat qqq 1 2 3 i have another file qqq02 cat qqq02 1 2 3 here qqq02 has having same contents as qqq file.. i need to check the duplicates files...

4. Shell Programming and Scripting

Script to find files and delete it by comparing

I have a directory where lot of "gzip" files are dropped in every 5 minutes. There is an application which will process these gzip and move it to another directory but will leave a gzip.out file with lot of output data. I need to remove all the outfiles except for the one which is being...

5. UNIX for Dummies Questions & Answers

sort and find duplicates for files with no white space

example data 5666700842511TAfmoham03151008075205999900000001000001000++ 5666700843130MAfmoham03151008142606056667008390315100005001 6666666663130MAfmoham03151008142606056667008390315100005001 I'd like to sort on position 10-14 where the characters are eq "130MA". Then based on positions...

6. Shell Programming and Scripting

comparing two files and find mismatch

hi i have two files and i want to compare both the files and find out mismatch in 3rd file file1 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|1|2 43236|1|0|1|1|0|0|0|1|2 41404|1|0|1|1|0|0|0|1|2 79968|1|0|1|1|0|0|0|1|2 file2 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|0|2...

7. Shell Programming and Scripting

Find duplicates from multuple files with 2 diff types of files

I need to compare 2 diff type of files and find out the duplicate after comparing each types of files: Type 1 file name is like: file1.abc (the extension abc could any 3 characters but I can narrow it down or hardcode for 10/15 combinations). The other file is file1.bcd01abc (the extension...

8. Shell Programming and Scripting

Comparing contents of files

Hi, I hav two files a1.txt and a2.txt, a1.txt contains: --------------- asdev ebcdev .... a2.txt contains: --------------- asdev ebcdev prod .... a1.txt will be updated by a process,.. now i want to compare two files and i want to see data which is not in a1.txt am i clear....?? ...

9. UNIX for Dummies Questions & Answers

Help comparing 2 files to find deleted records

Hi, I need to compare todays file to yesterdays file to find deletes. I cannot use comm -23 file.old file.new. Because each record may have a small change in it but is not really a delete. I have two delimited files. the first field in each file is static. All other fields may change. I...

10. Shell Programming and Scripting

comparing files to contents of a file

Hi I have a problem trying to run a while statement. I have files under one directory that i need to compare to a value in filex and update that file with the result files in the directory are DFC1. DFC5. DFC345. DFC344. DFC9. The program i am trying to run will take the number...

LEARN ABOUT OSX

opendiff

opendiff(1)						    BSD General Commands Manual 					       opendiff(1)

NAME

     opendiff -- Use FileMerge to graphically compare or merge file or directories

SYNOPSIS

     opendiff file1 file2 [-ancestor ancestorFile] [-merge mergeFile]
     opendiff dir1 dir2 [-ancestor ancestorDirectory] [-merge mergeDirectory]

DESCRIPTION

     opendiff is a command line utility that provides a convenient way to launch the FileMerge application from Terminal to graphically compare
     files or directories.  If FileMerge is already running, opendiff will connect to that running instance for the new comparison.  opendiff
     exits immediately after the comparison request has been sent to FileMerge.

     opendiff and FileMerge can be used to compare two files file1 and file2 or to compare two directories dir1 and dir2.

     If the -ancestor flag is given, FileMerge will compare the two files or directories to a common ancestor.	This is useful if two people inde-
     pendently modify copies of a single original file or directory.

     FileMerge lets you merge two files or directories together to create a third file or directory.  To see the contents of a merged file, drag
     the splitter bar at the bottom of FileMerge's file comparison window.  The contents of the merged file can be directly edited within File-
     Merge.  After editing, the merged file can be saved to the file (or into the directory) specified with the Fl merge flag.	If a destination
     is not specified with the -merge flag, FileMerge will ask for a destination file or directory when you try to save a merged file.

     For further information, please consult the Help information available from the FileMerge application.

FILES

     /Developer/Applications/Utilities/FileMerge.app

     opendiff and FileMerge are installed as part of the Mac OS X Developer Tools.

SEE ALSO

     diff(1), diff3(1), cmp(1)

Mac OS X							  August 3, 2004							  Mac OS X

UNIX for Advanced & Expert Users