Sponsored Content
Top Forums UNIX for Advanced & Expert Users How to find duplicates contents in a files by comparing other files? Post 302678045 by Ygor on Friday 27th of July 2012 06:37:03 AM
Old 07-27-2012
Perhaps try md5sum, e.g...
Code:
md5sum -t files* | awk 'a[$1]{printf "%s and %s are the same\n",a[$1],$2;next}{a[$1]=$2}'

This User Gave Thanks to Ygor For This Post:
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

comparing files to contents of a file

Hi I have a problem trying to run a while statement. I have files under one directory that i need to compare to a value in filex and update that file with the result files in the directory are DFC1. DFC5. DFC345. DFC344. DFC9. The program i am trying to run will take the number... (3 Replies)
Discussion started by: SummitElse
3 Replies

2. UNIX for Dummies Questions & Answers

Help comparing 2 files to find deleted records

Hi, I need to compare todays file to yesterdays file to find deletes. I cannot use comm -23 file.old file.new. Because each record may have a small change in it but is not really a delete. I have two delimited files. the first field in each file is static. All other fields may change. I... (2 Replies)
Discussion started by: eja
2 Replies

3. Shell Programming and Scripting

Comparing contents of files

Hi, I hav two files a1.txt and a2.txt, a1.txt contains: --------------- asdev ebcdev .... a2.txt contains: --------------- asdev ebcdev prod .... a1.txt will be updated by a process,.. now i want to compare two files and i want to see data which is not in a1.txt am i clear....?? ... (3 Replies)
Discussion started by: rrs
3 Replies

4. Shell Programming and Scripting

Find duplicates from multuple files with 2 diff types of files

I need to compare 2 diff type of files and find out the duplicate after comparing each types of files: Type 1 file name is like: file1.abc (the extension abc could any 3 characters but I can narrow it down or hardcode for 10/15 combinations). The other file is file1.bcd01abc (the extension... (2 Replies)
Discussion started by: ricky007
2 Replies

5. Shell Programming and Scripting

comparing two files and find mismatch

hi i have two files and i want to compare both the files and find out mismatch in 3rd file file1 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|1|2 43236|1|0|1|1|0|0|0|1|2 41404|1|0|1|1|0|0|0|1|2 79968|1|0|1|1|0|0|0|1|2 file2 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|0|2... (9 Replies)
Discussion started by: dodasajan
9 Replies

6. UNIX for Dummies Questions & Answers

sort and find duplicates for files with no white space

example data 5666700842511TAfmoham03151008075205999900000001000001000++ 5666700843130MAfmoham03151008142606056667008390315100005001 6666666663130MAfmoham03151008142606056667008390315100005001 I'd like to sort on position 10-14 where the characters are eq "130MA". Then based on positions... (0 Replies)
Discussion started by: mmarshall
0 Replies

7. Shell Programming and Scripting

Script to find files and delete it by comparing

I have a directory where lot of "gzip" files are dropped in every 5 minutes. There is an application which will process these gzip and move it to another directory but will leave a gzip.out file with lot of output data. I need to remove all the outfiles except for the one which is being... (1 Reply)
Discussion started by: gubbu
1 Replies

8. Shell Programming and Scripting

how to check the duplicates files contents

Hi all , am using unix aix .. how to check the duplicates files contents and moving to someother folders ex .. i have files called qqq cat qqq 1 2 3 i have another file qqq02 cat qqq02 1 2 3 here qqq02 has having same contents as qqq file.. i need to check the duplicates files... (1 Reply)
Discussion started by: Venkatesh1
1 Replies

9. Shell Programming and Scripting

Need Help with Bash - comparing directory contents with list of files

Hey guys, need help with a script I'm trying to write. Basically I need to compare the contents of a folder called "profiles" with a list of files called "template". when the file matches the contents of the folder it needs to set a variable called "checked" to "1" Cookies to anyone... (4 Replies)
Discussion started by: Scriporium
4 Replies

10. UNIX for Dummies Questions & Answers

Find a list of files in directory, move to new, allow duplicates

Greetings. I know enough Unix to be dangerous (!) and know that there is a clever way to do the following and it will save me about a day of agony (this time) and I will use it forever after! (many days of agony saved in the future)! Basically I need to find any image files (JPGs, PSDs etc)... (5 Replies)
Discussion started by: Clyde Lovett
5 Replies
AR(1)							      General Commands Manual							     AR(1)

NAME
ar - archive and library maintainer SYNOPSIS
ar key [ posname ] afile [ file ... ] DESCRIPTION
Ar maintains groups of files combined into a single archive file, afile. The main use of ar is to create and update library files for the loaders 2l(1), etc. It can be used, though, for any similar purpose. Key is one character from the set drqtpmx, optionally concatenated with one or more of vuaibclo. The files are constituents of the archive afile. The meanings of the key characters are: d Delete files from the archive file. r Replace files in the archive file, or add them if missing. Optional modifiers are u Replace only files with modified dates later than that of the archive. a Place new files after posname in the archive rather than at the end. b or i Place new files before posname in the archive. q Quick. Append files to the end of the archive without checking for duplicates. Avoids quadratic behavior in t List a table of contents of the archive. If names are given, only those files are listed. p Print the named files in the archive. m Move the named files to the end or elsewhere, specified as with o Preserve the access and modification times of files extracted with the x command. x Extract the named files. If no names are given, all files in the archive are extracted. In neither case does x alter the archive file. v Verbose. Give a file-by-file description of the making of a new archive file from the old archive and the constituent files. With p, precede each file with a name. With t, give a long listing of all information about the files, somewhat like a listing by ls(1), showing mode uid/gid size date name c Create. Normally ar will create a new archive when afile does not exist, and give a warning. Option c discards any old contents and suppresses the warning. l Local. Normally ar places its temporary files in the directory /tmp. This option causes them to be placed in the local directory. When a d, r, or m key is specified and all members of the archive are valid object files for the same architecture, ar inserts a table of contents, required by the loaders, at the front of the library. The table of contents is rebuilt whenever the archive is modified, except when the q key is specified or when the table of contents is explicitly moved or deleted. EXAMPLE
ar cr lib.a *.o Replace the contents of library with the object files in the current directory. FILES
/tmp/v* temporaries SOURCE
/sys/src/cmd/ar.c SEE ALSO
2l(1), ar(6) BUGS
If the same file is mentioned twice in an argument list, it may be put in the archive twice. This command predates Plan 9 and makes some invalid assumptions, for instance that user id's are numeric. AR(1)
All times are GMT -4. The time now is 04:55 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy