09-04-2006
how to find duplicate files with find ?
hello all
I like to make search on files , and the result need to be the files that are duplicated?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I need a perl script which will create an output file after comparing two diff file in a directory path:
/export/home/abc/file1
/export/home/abc/file2
File Format: <IP>TAB<DeviceName><TAB>DESCRIPTIONS
file1:
10.1.2.1.3<tab>abc123def<tab>xyz.mm1.ppp.... (2 Replies)
Discussion started by: ricky007
2 Replies
2. Shell Programming and Scripting
I have a directory with images:
-rw-r--r-- 1 root root 26216 Mar 19 21:00 020109.210001.jpg
-rw-r--r-- 1 root root 21760 Mar 19 21:15 020109.211502.jpg
-rw-r--r-- 1 root root 23144 Mar 19 21:30 020109.213002.jpg
-rw-r--r-- 1 root root 31350 Mar 20 00:45 020109.004501.jpg
-rw-r--r-- 1 root... (2 Replies)
Discussion started by: Ikon
2 Replies
3. Shell Programming and Scripting
What utility do you recommend for simply finding all duplicate files among all files? (4 Replies)
Discussion started by: kiasas
4 Replies
4. Shell Programming and Scripting
Hi!
I want to find duplicate files (criteria: file size) in my download folder.
I try it like this:
find /Users/frodo/Downloads \! -type d -exec du {} \; | sort > /Users/frodo/Desktop/duplicates_1.txt;
cut -f 1 /Users/frodo/Desktop/duplicates_1.txt | uniq -d | grep -hif -... (9 Replies)
Discussion started by: Dirk Einecke
9 Replies
5. Shell Programming and Scripting
I have more than 100 files like this:
SVEAVLTGPYGYT 2
SVEGNFEETQY 10
SVELGQGYEQY 28
SVERTGTGYT 6
SVGLADYNEQF 21
SVGQGYEQY 32
SVKTVLGYEQF 2
SVNNEQF 12
SVRDGLTNSPLH 3
SVRRDREGLEQF 11
SVRTSGSYEQY 17
SVSVSGSPLQETQY 78
SVVHSTSPEAF 59
SVVPGNGYT 75 (4 Replies)
Discussion started by: xshang
4 Replies
6. Shell Programming and Scripting
Hi !
I wonder if anyone can help on this : I have a directory: /xyz that has the following files:
chsLog.107.20130603.gz
chsLog.115.20130603
chsLog.111.20130603.gz
chsLog.107.20130603
chsLog.115.20130603.gz
As you ca see there are two files that are the same but only with a minor... (10 Replies)
Discussion started by: fretagi
10 Replies
7. Shell Programming and Scripting
Hi champs,
I have one of the requirement, where I need to compare two files line by line and ignore duplicates. Note, I hav files in sorted order.
I have tried using the comm command, but its not working for my scenario.
Input file1
srv1..development..employee..empname,empid,empdesg... (1 Reply)
Discussion started by: Selva_2507
1 Replies
8. Shell Programming and Scripting
I am so frustrated!!!
I want a nice command that clears away duplicate files:
find . -type f -regex '.*{1,3}\..*' | xargs -I## rm -v '##'
should work in my opinion. But it finds nothing even though I have files that have the file name:
Scooby-Doo-1.txt
Himalaya-2.jpg
Camping... (8 Replies)
Discussion started by: Mr.Glaurung
8 Replies
9. Shell Programming and Scripting
I have tried the following code and with that i couldnt achieve what i want.
#!/usr/bin/bash
find ./ -type f \( -iname "*.xml" \) | sort -n > fileList
sed -i '/\.\/fileList/d' fileList
NAMEOFTHISFILE=$(echo $0|sed -e 's/\/()$*.^|/\\&/g')
sed -i "/$NAMEOFTHISFILE/d"... (2 Replies)
Discussion started by: gold2k8
2 Replies
10. UNIX for Advanced & Expert Users
I would like find and delete old backup files in aix. How would I go about doing this? For example:
server1_1-20-2020
server1_1-21-2020
server1_1-22-2020
server1_1-23-2020
server2_1-20-2020
server2_1-21-2020
server2_1-22-2020
server2_1-23-2020
How would I go about finding and... (3 Replies)
Discussion started by: cokedude
3 Replies
ha(1) HA archiver ha(1)
NAME
ha - a small file archiver utility
SYNOPSIS
ha <command>[<option><option>...] archive [ name ... ]
DESCRIPTION
After the program name comes a command name (single letter) and options (single letters, appended to the command name without a space).
COMMANDS
a[sdqemr012]
Add files matching search pattern to archive.
e[aqty]
Extract files matching search pattern from archive.
x[aqty]
Extract files matching search pattern from archive using path information stored in archive.
l[f] List files currently in archive.
d[q] Delete files matching search pattern from archive. If archive does not contain any files after deletion it is removed.
f[sdqemr012]
Freshen files in archive. All files matching search pattern and newer than version already in archive are updated to archive.
u[sdqemr012]
Update files to archive. All files matching search pattern that are newer than version already in archive or are not yet in archive
are updated to archive.
t[q] Test files in archive.
OPTIONS
0,1,2 Try compression method #. More than one can be specified.
Methods are:
0-CPY Simple copying of files.
1-ASC Default method using sliding window dictionary followed by arithmetic
coder. Offers quite good compression on wide variety of file types.
2-HSC Compression method based on finite context model and arithmetic
coder. Quite slow for binary data, but offers very good compression
especially for longer text files.
y Assume answer yes on all questions.
t Touch files when extracting. Sets file times to current machine time.
r Recurse through subdirectories while searching for files matching search pattern.
f Full listing of stored file information.
m Move files when archiving. Files are removed from disk after they are successfully written to archive.
a Set system specific file attributes when extracting files.
s Find special files when archiving.
e Do not store pathname information.
q Quiet operation.
d Make separate entries for directories. Saves information about empty directories, directory attributes etc. in archive.
AUTHOR
This manual page was written by Mikhail Gusarov <dottedmag@dottedmag.net> for Debian GNU/Linux system (but may be used by others).
ha 0.999p 3 Jul 2008 ha(1)