Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Dealing with files with spaces in the name
Top Forums Shell Programming and Scripting Dealing with files with spaces in the name Post 302360712 by Scott on Friday 9th of October 2009 09:04:22 PM
Old 10-09-2009
Hi.

That was interesting!

Code:
#This script will search out duplicate files and remove duplicates
#
#directory=NULL
#echo "Wht directory would you like to remove duplicates from?"
#read directory
cd ~/Desktop/test_remove
for i in *
do
  for j in *
  do
    if [ "$i" != "$j" ]
    then
      cmp -s -- "$i" "$j"
      c=$?
      if [ $c == 0 ]
      then
        if [[ "$j" > "$i" ]]
        then
          rm -- "$j" 2> /dev/null
        else
          rm -- "$i" 2> /dev/null
        fi
      fi
    fi
  done
done
exit 1

I got it to work with [[ ]] on the $j > $i if statement.

Not sure I'd use this approach to the problem, but it seems to wok.

Two things to note. It won't work (or will give errors) if you have directories in the test_remove directory; and i and j are expanded in the beginning to the file list so you will try to delete each file twice (which is why I put 2> /dev/null on the rm commands)
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

perl: When dealing with files that do not exist

I have a process run weekly where I must convert data formats for about thirty files. I read a text file that provides all of the filenames and switch settings. My perl code is: for ($j = 1; $j <= $k; $j++) { open(FIN2,$fin2) || die "open: $!"; do other stuff } Every once in... (2 Replies)
Discussion started by: joeyg
2 Replies

2. Shell Programming and Scripting

Files with spaces....

Ok, I have this script that will look for files with the .pl4 extension and rename them with the modification date... But it breaks when the file has a space in it... (files are on windows machine) ive been trying to fix it but no luck.... Any help is greatly appriciated.. #! /bin/sh for file... (1 Reply)
Discussion started by: Jay5487
1 Replies

3. Shell Programming and Scripting

Dealing with spaces in file names in a shell script

Hi, What's the best way to find all files under a directory - including ones with space - in order to apply a command to each of them. For instance I want get a list of files under a directory and generate a checksum for each file. Here's the csh script: #!/bin/csh set files = `find $1... (5 Replies)
Discussion started by: same1290
5 Replies

4. Shell Programming and Scripting

Dealing with log files

Hi , My requirement is that i need to search for a number of strings in a log file and print them with line numbers.The search should be date wise. The sample log file is : Jan 17 02:45:34 srim6165 MQSIv500: (UKBRKR1P_B.LZ_ BENCHMARKS)BIP2648E: Message backed out to a queue; node... (6 Replies)
Discussion started by: charudpss
6 Replies

5. UNIX for Dummies Questions & Answers

How to read files with spaces

Hi I am a newbie to unix. I have a current script that reads a directory for excel files and renames the files. There is a problem now because some of the files have spaces. If I put quotes on the file, it will work but I dont know how to read all the files with quotes. Variables $1 =... (6 Replies)
Discussion started by: Lillyt
6 Replies

6. Shell Programming and Scripting

Iterating over subdirectories and dealing with files within them

Hello, I am working on a coding project for a class and to test the program I have created, I have come up with 100 different test cases. The program takes four text files as input, so each of the test cases is contained in a folder with four files. I have a folder called 'tests', within which... (1 Reply)
Discussion started by: dpryor
1 Replies

7. UNIX for Dummies Questions & Answers

Dealing with Empty files, AWK and Loops

I write this bit of code to calculate the mean and variance for all the files in one directory and print the mean and variance in a separate folder but with the same file name. FILES="data/*" for X in $FILES do name=$(basename $X) awk '{x=$0; s+=$0; n++} END{mean=s/n; for (i in x){ss... (20 Replies)
Discussion started by: A-V
20 Replies

8. Shell Programming and Scripting

Dealing with multiple files

Korn Shell I have hundreds of small files like below created every day. A midnight cron job moves them to the location /u04/temp/logs But sometimes I have to manually move these files based a certain dates or time. I have two basic requirements 1.Using mv command I want to move all .dat... (2 Replies)
Discussion started by: kraljic
2 Replies

9. Shell Programming and Scripting

Dealing with white spaces in bash scripts

I'm trying to search for all files in directory with particular GID then change the GID to match the UID of each file: #!/bin/sh for i in $(find /dump -gid 200 | sed 's/\ /\\\ /g' | sed 's/\&/\\\&/g'); do chgrp $(ls -ln ${i} | awk '{print $3}') ${i} done I'm using sed to deal with... (7 Replies)
Discussion started by: venmx
7 Replies

10. Shell Programming and Scripting

Dealing with filename spaces in Perl

The following command to replace text in place in multiple files in a directory is tripping up on filename spaces (Windows environment). I really don't know Perl. find '\\server\directory' | xargs perl -pi -e 's/textA/textB/g'Mike (2 Replies)
Discussion started by: Michael Stora
2 Replies

LEARN ABOUT DEBIAN

fdupes

FDUPES(1)						      General Commands Manual							 FDUPES(1)

NAME

       fdupes - finds duplicate files in a given set of directories

SYNOPSIS

       fdupes [ options ] DIRECTORY ...

DESCRIPTION

       Searches  the  given  path for duplicate files. Such files are found by comparing file sizes and MD5 signatures, followed by a byte-by-byte
       comparison.

OPTIONS

       -r --recurse
	      for every directory given follow subdirectories encountered within

       -R --recurse:
	      for each directory given after this option follow subdirectories encountered within (note the ':' at the	end  of  option;  see  the
	      Examples section below for further explanation)

       -s --symlinks
	      follow symlinked directories

       -H --hardlinks
	      normally, when two or more files point to the same disk area they are treated as non-duplicates; this option will change this behav-
	      ior

       -n --noempty
	      exclude zero-length files from consideration

       -f --omitfirst
	      omit the first file in each set of matches

       -A --nohidden
	      exclude hidden files from consideration

       -1 --sameline
	      list each set of matches on a single line

       -S --size
	      show size of duplicate files

       -m --summarize
	      summarize duplicate files information

       -q --quiet
	      hide progress indicator

       -d --delete
	      prompt user for files to preserve, deleting all others (see CAVEATS below)

       -N --noprompt
	      when used together with --delete, preserve the first file in each set of duplicates and delete the others without prompting the user

       -v --version
	      display fdupes version

       -h --help
	      displays help

SEE ALSO

       md5sum(1)

NOTES

       Unless -1 or --sameline is specified, duplicate files are listed together in groups, each file displayed on a separate line. The groups are
       then separated from each other by blank lines.

       When -1 or --sameline is specified, spaces and backslash characters  () appearing in a filename are preceded by a backslash character.

EXAMPLES

       fdupes a --recurse: b
	      will follow subdirectories under b, but not those under a.

       fdupes a --recurse b
	      will follow subdirectories under both a and b.

CAVEATS

       If  fdupes  returns  with  an error message such as fdupes: error invoking md5sum it means the program has been compiled to use an external
       program to calculate MD5 signatures (otherwise, fdupes uses internal routines for this purpose), and an error has occurred while attempting
       to execute it. If this is the case, the specified program should be properly installed prior to running fdupes.

       When using -d or --delete, care should be taken to insure against accidental data loss.

       When used together with options -s or --symlink, a user could accidentally preserve a symlink while deleting the file it points to.

       Furthermore, when specifying a particular directory more than once, all files within that directory will be listed as their own duplicates,
       leading to data loss should a user preserve a file without its "duplicate" (the file itself!).

AUTHOR

       Adrian Lopez <adrian2@caribe.net>

																	 FDUPES(1)
All times are GMT -4. The time now is 02:36 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy