How to find duplicates contents in a files by comparing other files?

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Find a list of files in directory, move to new, allow duplicates

Greetings. I know enough Unix to be dangerous (!) and know that there is a clever way to do the following and it will save me about a day of agony (this time) and I will use it forever after! (many days of agony saved in the future)! Basically I need to find any image files (JPGs, PSDs etc)...

2. Shell Programming and Scripting

Need Help with Bash - comparing directory contents with list of files

Hey guys, need help with a script I'm trying to write. Basically I need to compare the contents of a folder called "profiles" with a list of files called "template". when the file matches the contents of the folder it needs to set a variable called "checked" to "1" Cookies to anyone...

3. Shell Programming and Scripting

how to check the duplicates files contents

Hi all , am using unix aix .. how to check the duplicates files contents and moving to someother folders ex .. i have files called qqq cat qqq 1 2 3 i have another file qqq02 cat qqq02 1 2 3 here qqq02 has having same contents as qqq file.. i need to check the duplicates files...

4. Shell Programming and Scripting

Script to find files and delete it by comparing

I have a directory where lot of "gzip" files are dropped in every 5 minutes. There is an application which will process these gzip and move it to another directory but will leave a gzip.out file with lot of output data. I need to remove all the outfiles except for the one which is being...

5. UNIX for Dummies Questions & Answers

sort and find duplicates for files with no white space

example data 5666700842511TAfmoham03151008075205999900000001000001000++ 5666700843130MAfmoham03151008142606056667008390315100005001 6666666663130MAfmoham03151008142606056667008390315100005001 I'd like to sort on position 10-14 where the characters are eq "130MA". Then based on positions...

6. Shell Programming and Scripting

comparing two files and find mismatch

hi i have two files and i want to compare both the files and find out mismatch in 3rd file file1 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|1|2 43236|1|0|1|1|0|0|0|1|2 41404|1|0|1|1|0|0|0|1|2 79968|1|0|1|1|0|0|0|1|2 file2 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|0|2...

7. Shell Programming and Scripting

Find duplicates from multuple files with 2 diff types of files

I need to compare 2 diff type of files and find out the duplicate after comparing each types of files: Type 1 file name is like: file1.abc (the extension abc could any 3 characters but I can narrow it down or hardcode for 10/15 combinations). The other file is file1.bcd01abc (the extension...

8. Shell Programming and Scripting

Comparing contents of files

Hi, I hav two files a1.txt and a2.txt, a1.txt contains: --------------- asdev ebcdev .... a2.txt contains: --------------- asdev ebcdev prod .... a1.txt will be updated by a process,.. now i want to compare two files and i want to see data which is not in a1.txt am i clear....?? ...

9. UNIX for Dummies Questions & Answers

Help comparing 2 files to find deleted records

Hi, I need to compare todays file to yesterdays file to find deletes. I cannot use comm -23 file.old file.new. Because each record may have a small change in it but is not really a delete. I have two delimited files. the first field in each file is static. All other fields may change. I...

10. Shell Programming and Scripting

comparing files to contents of a file

Hi I have a problem trying to run a while statement. I have files under one directory that i need to compare to a value in filex and update that file with the result files in the directory are DFC1. DFC5. DFC345. DFC344. DFC9. The program i am trying to run will take the number...

LEARN ABOUT DEBIAN

avinfo

AVINFO(1)							   User Commands							 AVINFO(1)

NAME

       AVInfo - Audio/Video file information automatic extractor

SYNOPSIS

       avinfo [FILENAME] [OPTIONS] [TEMPLATE] [OUTPUT]
       avinfo [-l=FILELIST] [OPTIONS] [TEMPLATE] [OUTPUT]
       avinfo -l- [OPTIONS] [TEMPLATE] [OUTPUT]
       avinfo [--help | --version]

DESCRIPTION

       Extracts information from FILENAME or files in FILELIST and generates a report.

   OPTIONS:
       -f=extension
	      forces the use of module associated with extension

       -l=list
	      use filelist (use -l- for stdin)

       -i=ms  delay between files in filelist (in ms) (/*TODO*/)

       -e=ext exclude an extension (do not apply associated module)

       -m=number
	      max line length (0 - no restriction)

       -s=value
	      for advanced tuning of modules (/*TODO*/)

       -v=name=value
	      set int. variable 'name' to 'value' (text or number)

   External TEMPLATEs:
       -th=template
	      header template (string, use without value to disable)

       -thf=filename
	      get header template from a file

       -tb=template
	      body template (string, use without value to disable)

       -tbf=filename
	      get body template from a file

       -tf=template
	      footer template (string, use without value to disable)

       -tff=filename
	      get footer template from a file

   Built-in TEMPLATEs:
       --default
	      used by default

       --description
	      for creating (updating) descrpipt.ion files

       --list for filelist (plain text) generation

       --html-list
	      for filelist (html) generation

       --csv-list
	      for filelist (CSV, e.g. for Excel)

       --short
	      alt. version of --default template

       --far  "nice" formated report (for FAR Manager) (contains MS-DOS pseudographic characters)

   OUTPUT:
       -o=file
	      file to write the report to (default is stdout)

   Other OPTIONS:
       --help prints this help page

       --version
	      prints avinfo version and copyright

       You can use ':' instead of '=' in all OPTIONS or just omit it.
       TEMPLATEs use AVInfo Simple Script (A.S.S.) syntax.

   Examples of commands:
       avinfo file.ogm --raw
       find . -name '*.avi' -print | avinfo -l- --html-list -o=avilist.html
       avinfo -l:list -thf:header -tbf=body -tff=footer >report

SEE ALSO

       Additional documentation for AVInfo can be found in the package documentation directory.

       (c) George Shuklin, 2001-2004, http://shounen.ru/soft/avinfo/
       This is free software. You are welcome to redistribute it under the terms and conditions of GNU General Public License.

AVInfo 1.0 alpha 15 [Balalaika] 				    April 2005								 AVINFO(1)

UNIX for Advanced & Expert Users