10-16-2013
The aim being to delete duplicate files from dir2 and sub-directories?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello,
I want to compare two files. All records in file 2 that are not in file 1 should be output to file 3.
For example:
file 1
123
1234
123456
file 2
123
2345
23456
file 3 should have
2345
23456
I have looked at diff, bdiff, cmp, comm, diff3 without any luck! (2 Replies)
Discussion started by: blt123
2 Replies
2. UNIX for Dummies Questions & Answers
I have two CSV files and I would like to create a third CSV file containing the differences between the two.
I understand the diff command can be used to list differences between two files. My problem is that when I pipe the output into a third CSV file, the line numbers and other formatting... (3 Replies)
Discussion started by: paulp
3 Replies
3. Shell Programming and Scripting
Hello is there a way to limit the number of lines output by the DIFF command?
I tried -C 200 ect and -c but it continues to print out the whole huge file.
Reason needed is i'm trying to do alot of DIFFs on a long list of files and would like to only get back an indicator which files are... (2 Replies)
Discussion started by: bobk544
2 Replies
4. Shell Programming and Scripting
Hi,
i need to display the mismatches from two files.The output what is get is the entire rows which mismatch from file 1 are displayed first and the corresponding rows from file 2 are displayed below it.
Sample output:
From Test Run 1 - The row count of file2.txt is 23
From Test Run 1 -... (9 Replies)
Discussion started by: ragavhere
9 Replies
5. Shell Programming and Scripting
I need to compare two directories with tab separated files. I'm using diff to do this. diff output doesn't identify which column values are different, it just tells which lines are different. Is there any way to format diff output. Thanks
f1.txt
210 998877 phone 9981128209 add 111 nw st.... (2 Replies)
Discussion started by: blackjack101
2 Replies
6. Shell Programming and Scripting
I have two files to compare, but diff output doesn't give me decent output I want.
The portion of the two files are shown below.
file 1)
Authorize <1>
Transaction Database Slave 3 <1>
CPM HTTP Proxy Server <1>
SSP (TDB Server) <1>
CPM Application Authorization <7>
CPM Script... (5 Replies)
Discussion started by: Daniel Gate
5 Replies
7. Shell Programming and Scripting
hello everyone,
I am trying to compare two files and have the result in a new files. When I used diff I am getting the header, '<' and '>' in my result which I don't want to have it in my output file. :wall:
opt/sam/input: diff file1.txt file2.txt
1,20d0
< 16,ZA,
< ZJ,08,
< Z7,03,
Any... (1 Reply)
Discussion started by: siteregsam
1 Replies
8. Shell Programming and Scripting
How to get diff to not print the chevrons and the dashes? In this case the differences are all single line differences.
Also the first few lines don't matter. How to get the output to always exclude the first few lines? Thanks! (1 Reply)
Discussion started by: stevensw
1 Replies
9. UNIX for Dummies Questions & Answers
35d34
<
What does that mean in diff? (3 Replies)
Discussion started by: glev2005
3 Replies
10. UNIX for Dummies Questions & Answers
Hi,
I wasn't sure whether to post this in the dummies or expert section, here's what I'm trying to do, but I suspect I'm missing the boat and should perhaps be using some of diff's builtin output functionality.
diff -yb --suppress-common-lines file1.js file2.js >> ~/results.txt
When I... (5 Replies)
Discussion started by: Buckaroo Banzai
5 Replies
FDUPES(1) General Commands Manual FDUPES(1)
NAME
fdupes - finds duplicate files in a given set of directories
SYNOPSIS
fdupes [ options ] DIRECTORY ...
DESCRIPTION
Searches the given path for duplicate files. Such files are found by comparing file sizes and MD5 signatures, followed by a byte-by-byte
comparison.
OPTIONS
-r --recurse
include files residing in subdirectories
-s --symlinks
follow symlinked directories
-H --hardlinks
normally, when two or more files point to the same disk area they are treated as non-duplicates; this option will change this behav-
ior
-n --noempty
exclude zero-length files from consideration
-f --omitfirst
omit the first file in each set of matches
-1 --sameline
list each set of matches on a single line
-S --size
show size of duplicate files
-q --quiet
hide progress indicator
-d --delete
prompt user for files to preserve, deleting all others (see CAVEATS below)
-v --version
display fdupes version
-h --help
displays help
SEE ALSO
md5sum(1)
NOTES
Unless -1 or --sameline is specified, duplicate files are listed together in groups, each file displayed on a separate line. The groups are
then separated from each other by blank lines.
When -1 or --sameline is specified, spaces and backslash characters () appearing in a filename are preceded by a backslash character.
CAVEATS
If fdupes returns with an error message such as fdupes: error invoking md5sum it means the program has been compiled to use an external
program to calculate MD5 signatures (otherwise, fdupes uses interal routines for this purpose), and an error has occurred while attempting
to execute it. If this is the case, the specified program should be properly installed prior to running fdupes.
When using -d or --delete, care should be taken to insure against accidental data loss.
When used together with options -s or --symlink, a user could accidentally preserve a symlink while deleting the file it points to.
Furthermore, when specifying a particular directory more than once, all files within that directory will be listed as their own duplicates,
leading to data loss should a user preserve a file without its "duplicate" (the file itself!).
AUTHOR
Adrian Lopez <adrian2@caribe.net>
FDUPES(1)