|
|
Sponsored Content
Top Forums
UNIX for Advanced & Expert Users
How to find duplicates contents in a files by comparing other files?
Post 302678045 by Ygor on Friday 27th of July 2012 06:37:03 AM
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi I have a problem trying to run a while statement.
I have files under one directory that i need to compare to a value in filex and update that file with the result
files in the directory are
DFC1.
DFC5.
DFC345.
DFC344.
DFC9.
The program i am trying to run will take the number... (3 Replies)
Discussion started by: SummitElse
3 Replies
2. UNIX for Dummies Questions & Answers
Hi,
I need to compare todays file to yesterdays file to find deletes.
I cannot use comm -23 file.old file.new.
Because each record may have a small change in it but is not really a delete.
I have two delimited files. the first field in each file is static. All other fields may change. I... (2 Replies)
Discussion started by: eja
2 Replies
3. Shell Programming and Scripting
Hi,
I hav two files a1.txt and a2.txt,
a1.txt contains:
---------------
asdev ebcdev ....
a2.txt contains:
---------------
asdev ebcdev prod ....
a1.txt will be updated by a process,..
now i want to compare two files and i want to see data which is not in a1.txt
am i clear....??
... (3 Replies)
Discussion started by: rrs
3 Replies
4. Shell Programming and Scripting
I need to compare 2 diff type of files and find out the duplicate after comparing each types of files:
Type 1 file name is like: file1.abc
(the extension abc could any 3 characters but I can narrow it down or hardcode for 10/15 combinations).
The other file is file1.bcd01abc (the extension... (2 Replies)
Discussion started by: ricky007
2 Replies
5. Shell Programming and Scripting
hi i have two files and i want to compare both the files and find out mismatch in 3rd file
file1
00354|1|0|1|1|0|0|0|1|2
52424|1|0|1|1|0|0|0|1|2
43236|1|0|1|1|0|0|0|1|2
41404|1|0|1|1|0|0|0|1|2
79968|1|0|1|1|0|0|0|1|2
file2
00354|1|0|1|1|0|0|0|1|2
52424|1|0|1|1|0|0|0|0|2... (9 Replies)
Discussion started by: dodasajan
9 Replies
6. UNIX for Dummies Questions & Answers
example data
5666700842511TAfmoham03151008075205999900000001000001000++
5666700843130MAfmoham03151008142606056667008390315100005001
6666666663130MAfmoham03151008142606056667008390315100005001
I'd like to sort on position 10-14 where the characters are eq "130MA".
Then based on positions... (0 Replies)
Discussion started by: mmarshall
0 Replies
7. Shell Programming and Scripting
I have a directory where lot of "gzip" files are dropped in every 5 minutes. There is an application which will process these gzip and move it to another directory but will leave a gzip.out file with lot of output data.
I need to remove all the outfiles except for the one which is being... (1 Reply)
Discussion started by: gubbu
1 Replies
8. Shell Programming and Scripting
Hi all ,
am using unix aix ..
how to check the duplicates files contents and moving to someother folders
ex ..
i have files called qqq
cat qqq
1
2
3
i have another file qqq02
cat qqq02
1
2
3
here qqq02 has having same contents as qqq file..
i need to check the duplicates files... (1 Reply)
Discussion started by: Venkatesh1
1 Replies
9. Shell Programming and Scripting
Hey guys,
need help with a script I'm trying to write.
Basically I need to compare the contents of a folder called "profiles"
with a list of files called "template".
when the file matches the contents of the folder it needs to set a variable called "checked" to "1"
Cookies to anyone... (4 Replies)
Discussion started by: Scriporium
4 Replies
10. UNIX for Dummies Questions & Answers
Greetings. I know enough Unix to be dangerous (!) and know that there is a clever way to do the following and it will save me about a day of agony (this time) and I will use it forever after! (many days of agony saved in the future)!
Basically
I need to find any image files (JPGs, PSDs etc)... (5 Replies)
Discussion started by: Clyde Lovett
5 Replies
LEARN ABOUT DEBIAN
md5sum
MD5SUM(1) User Commands MD5SUM(1) NAME
md5sum - compute and check MD5 message digest SYNOPSIS
md5sum [OPTION]... [FILE]... DESCRIPTION
Print or check MD5 (128-bit) checksums. With no FILE, or when FILE is -, read standard input. -b, --binary read in binary mode -c, --check read MD5 sums from the FILEs and check them -t, --text read in text mode (default) The following three options are useful only when verifying checksums: --quiet don't print OK for each successfully verified file --status don't output anything, status code shows success -w, --warn warn about improperly formatted checksum lines --strict with --check, exit non-zero for any invalid input --help display this help and exit --version output version information and exit The sums are computed as described in RFC 1321. When checking, the input should be a former output of this program. The default mode is to print a line with checksum, a character indicating type (`*' for binary, ` ' for text), and name for each FILE. BUGS
The MD5 algorithm should not be used any more for security related purposes. Instead, better use an SHA-2 algorithm, implemented in the programs sha224sum(1), sha256sum(1), sha384sum(1), sha512sum(1) AUTHOR
Written by Ulrich Drepper, Scott Miller, and David Madore. REPORTING BUGS
Report md5sum bugs to bug-coreutils@gnu.org GNU coreutils home page: <http://www.gnu.org/software/coreutils/> General help using GNU software: <http://www.gnu.org/gethelp/> Report md5sum translation bugs to <http://translationproject.org/team/> COPYRIGHT
Copyright (C) 2011 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>. This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. SEE ALSO
The full documentation for md5sum is maintained as a Texinfo manual. If the info and md5sum programs are properly installed at your site, the command info coreutils 'md5sum invocation' should give you access to the complete manual. GNU coreutils 8.12.197-032bb September 2011 MD5SUM(1)