Sponsored Content
Top Forums Shell Programming and Scripting Find duplicate filenames and remove in different mount point Post 302353669 by thegeek on Tuesday 15th of September 2009 11:26:03 PM
Old 09-16-2009
lot of open source tools are available in sourceforge, as
fdupes & finddup and so on.
 

8 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

mount point

hi people, I'm trying to create a mount point, but am having no sucess at all, with the following: mount -F ufs /dev/dsk/diskname /newdirectory but i keep getting - mount-point /newdirectory doesn't exist. What am i doing wrong/missing? Thanks Rc (1 Reply)
Discussion started by: colesy
1 Replies

2. UNIX for Dummies Questions & Answers

tar contains duplicate filenames

I have a problem where tar is somehow creating duplicate filenames when tarring a directory. Doing an ls on the directory does not show any duplicate filenames, yet when the directory is tarred, you can see that there are duplicates: bash-2.03# pwd /var/log/cricket bash-2.03# ls -1 | sort |... (2 Replies)
Discussion started by: dangral
2 Replies

3. Shell Programming and Scripting

Remove Duplicate Filenames in 2 very large directories

Hello Gurus, O/S RHEL4 I have a requirement to compare two linux based directories for duplicate filenames and remove them. These directories are close to 2 TB each. I have tried running a: Prompt>diff -r data1/ data2/ I have tried this as well: jason@jason-desktop:~$ cat script.sh ... (7 Replies)
Discussion started by: jaysunn
7 Replies

4. UNIX for Dummies Questions & Answers

find & remove characters in filenames

I have a group of files in different directories with characters such as " ? : in the file names. How do I find these files and remove these characters on mass? Thanks (19 Replies)
Discussion started by: barrydocks
19 Replies

5. Shell Programming and Scripting

Find and remove duplicate record and print list

Gents, I needs to delete duplicate values and only get uniq values based in columns 2-27 Always we should keep the last record found... I need to store one clean file and other with the duplicate values removed. Input : S3033.0 7305.01 0 420123.8... (18 Replies)
Discussion started by: jiam912
18 Replies

6. Shell Programming and Scripting

Script to find a mount point on multiple server

Hi, I have to find a mount point called... /opt/recall on multiple servers.. .Could someone give me a suggestion on how I could do this? (2 Replies)
Discussion started by: gartie
2 Replies

7. UNIX for Beginners Questions & Answers

How to create a new mount point with 600GB and add 350 GBexisting mount point? IN AIX

How to create a new mount point with 600GB and add 350 GBexisting mount point Best if there step that i can follow or execute before i mount or add diskspace IN AIX Thanks (2 Replies)
Discussion started by: Thilagarajan
2 Replies

8. UNIX for Beginners Questions & Answers

Mount Point is locked

Hi there, I have a mount point that is locked. How do I unlocked it? (1 Reply)
Discussion started by: alvinoo
1 Replies
FINDDUP(1)							       Perl								FINDDUP(1)

NAME
finddup - Find identical files and do something with them SYNOPSIS
Usage: finddup [options...] --man the manpage -h, --help a short help --version the version (CVS) of the program -n, --noaction do just nothing, just print out (implies -v) -v, --verbose just what the name says -q, --quiet be quiet -l, --link link the identical files together -o, --oldresult Use the old output of this script -i, --ignore-perms Don't check that file owner and permissions match -d, --dir Define the dir to check (you may specify more than one) DESCRIPTION
finddup search the working directory and all files below on the same partition for duplicate files. finddup can optional hardlink such files to save space. Files size 0 will not be reported or hardlinked as this might give problemes later. This is a complete rewrite of the finddup in perl to handle several issues: - Allow spaces and other characters in filenames - be faster - include nodup in same script - Handle files that already have other hardlinks in the same tree - Several improvements If started as nodup or nodup.pl the script will act like started with options --link and --oldresult COPYRIGHT
Copyright (c) 2005 by Klaus Ethgen. All rights reserved. LICENSE
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER- CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. AUTHOR
Klaus Ethgen <Klaus@Ethgen.de<gt> HISTORY
$Log: finddup,v $ Revision 2.3 2005/02/06 18:57:42 klaus * Make --oldresult faster by not calculating the md5sum again * Fix a but that with --oldresult no links will be done cause the internal datastructure * Do handle errors in open for md5sum calculation Revision 2.2 2005/02/06 12:21:02 klaus Little but important bug in link routine. Revision 2.1 2005/02/05 18:43:11 klaus Just cosmetic Revision 2.0 2005/02/05 18:41:20 klaus Completely new version Contributed User FINDDUP(1)
All times are GMT -4. The time now is 08:31 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy