Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Dealing with files with spaces in the name
Top Forums Shell Programming and Scripting Dealing with files with spaces in the name Post 302360712 by Scott on Friday 9th of October 2009 09:04:22 PM
Old 10-09-2009
Hi.

That was interesting!

Code:
#This script will search out duplicate files and remove duplicates
#
#directory=NULL
#echo "Wht directory would you like to remove duplicates from?"
#read directory
cd ~/Desktop/test_remove
for i in *
do
  for j in *
  do
    if [ "$i" != "$j" ]
    then
      cmp -s -- "$i" "$j"
      c=$?
      if [ $c == 0 ]
      then
        if [[ "$j" > "$i" ]]
        then
          rm -- "$j" 2> /dev/null
        else
          rm -- "$i" 2> /dev/null
        fi
      fi
    fi
  done
done
exit 1

I got it to work with [[ ]] on the $j > $i if statement.

Not sure I'd use this approach to the problem, but it seems to wok.

Two things to note. It won't work (or will give errors) if you have directories in the test_remove directory; and i and j are expanded in the beginning to the file list so you will try to delete each file twice (which is why I put 2> /dev/null on the rm commands)
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

perl: When dealing with files that do not exist

I have a process run weekly where I must convert data formats for about thirty files. I read a text file that provides all of the filenames and switch settings. My perl code is: for ($j = 1; $j <= $k; $j++) { open(FIN2,$fin2) || die "open: $!"; do other stuff } Every once in... (2 Replies)
Discussion started by: joeyg
2 Replies

2. Shell Programming and Scripting

Files with spaces....

Ok, I have this script that will look for files with the .pl4 extension and rename them with the modification date... But it breaks when the file has a space in it... (files are on windows machine) ive been trying to fix it but no luck.... Any help is greatly appriciated.. #! /bin/sh for file... (1 Reply)
Discussion started by: Jay5487
1 Replies

3. Shell Programming and Scripting

Dealing with spaces in file names in a shell script

Hi, What's the best way to find all files under a directory - including ones with space - in order to apply a command to each of them. For instance I want get a list of files under a directory and generate a checksum for each file. Here's the csh script: #!/bin/csh set files = `find $1... (5 Replies)
Discussion started by: same1290
5 Replies

4. Shell Programming and Scripting

Dealing with log files

Hi , My requirement is that i need to search for a number of strings in a log file and print them with line numbers.The search should be date wise. The sample log file is : Jan 17 02:45:34 srim6165 MQSIv500: (UKBRKR1P_B.LZ_ BENCHMARKS)BIP2648E: Message backed out to a queue; node... (6 Replies)
Discussion started by: charudpss
6 Replies

5. UNIX for Dummies Questions & Answers

How to read files with spaces

Hi I am a newbie to unix. I have a current script that reads a directory for excel files and renames the files. There is a problem now because some of the files have spaces. If I put quotes on the file, it will work but I dont know how to read all the files with quotes. Variables $1 =... (6 Replies)
Discussion started by: Lillyt
6 Replies

6. Shell Programming and Scripting

Iterating over subdirectories and dealing with files within them

Hello, I am working on a coding project for a class and to test the program I have created, I have come up with 100 different test cases. The program takes four text files as input, so each of the test cases is contained in a folder with four files. I have a folder called 'tests', within which... (1 Reply)
Discussion started by: dpryor
1 Replies

7. UNIX for Dummies Questions & Answers

Dealing with Empty files, AWK and Loops

I write this bit of code to calculate the mean and variance for all the files in one directory and print the mean and variance in a separate folder but with the same file name. FILES="data/*" for X in $FILES do name=$(basename $X) awk '{x=$0; s+=$0; n++} END{mean=s/n; for (i in x){ss... (20 Replies)
Discussion started by: A-V
20 Replies

8. Shell Programming and Scripting

Dealing with multiple files

Korn Shell I have hundreds of small files like below created every day. A midnight cron job moves them to the location /u04/temp/logs But sometimes I have to manually move these files based a certain dates or time. I have two basic requirements 1.Using mv command I want to move all .dat... (2 Replies)
Discussion started by: kraljic
2 Replies

9. Shell Programming and Scripting

Dealing with white spaces in bash scripts

I'm trying to search for all files in directory with particular GID then change the GID to match the UID of each file: #!/bin/sh for i in $(find /dump -gid 200 | sed 's/\ /\\\ /g' | sed 's/\&/\\\&/g'); do chgrp $(ls -ln ${i} | awk '{print $3}') ${i} done I'm using sed to deal with... (7 Replies)
Discussion started by: venmx
7 Replies

10. Shell Programming and Scripting

Dealing with filename spaces in Perl

The following command to replace text in place in multiple files in a directory is tripping up on filename spaces (Windows environment). I really don't know Perl. find '\\server\directory' | xargs perl -pi -e 's/textA/textB/g'Mike (2 Replies)
Discussion started by: Michael Stora
2 Replies

LEARN ABOUT DEBIAN

emgrip-dupes

EMGRIP-DUPES(1) 					User Contributed Perl Documentation					   EMGRIP-DUPES(1)

NAME

       emgrip-dupes - find packages listed in more than one component

Synopsis
	Syntax: emgrip-dupes -b PATH [OPTIONS]
		emgrip-dupes -b PATH -m|--merge NAME [OPTIONS]
		emgrip-dupes -b PATH -p|--purge NAME [OPTIONS]
		emgrip-dupes -?|-h|--help|--version

	Commands:
	-b|--base-path PATH:	       path to the top level grip directory [required]
	-a|--arch ARCHITECTURE:        architecture to test [default: i386]
	-m|--merge NAMES:	       retain this duplicate at the latest version in all
	-p|--purge NAMES:	       remove the duplicates from 'main'
	-t|--trim NAMES:	       retain the duplicates in main only
	-?|-h|--help|--version:        print this help message and exit

       Options:
	   --grip-name STRING:	       alternative name for the grip repository
	-s|--suite SUITE:	       suite to check (default: unstable)
	-n|--dry-run:		       print the reprepro commands that would be used.

Description
       emgrip-dupes scans the Grip repository Packages data and configuration, identifies the supported list of components in the requested suite.

       In some cases, these duplicates are useful and only a small amount of space is taken up by the extra listing. However, the version in one
       component can easily be out of sync with the version in another.

       The main emphasis is on the size of the Packages file for the 'main' component (the one that every user needs to download). Purge mode will
       remove the listing of the specified package from 'main'. Merge mode will bring the outdated version into line with the most recent version
       of the package so that all components list the most recent version.

Limitations
       Next step is to automate the "correction" of the duplicates but this does need care. Manual corrections involve identifying the packages to
       retain in main (where the duplicate in dev, doc or debug is not wanted) and pass those to --trim.

       The more complex case is to remove from main (e.g. package name suffix is -dev or -doc or -dbg or the Section is devel, dbg, doc or
       libdevel).  emgrip-dupes --purge removes each binary separately because removing the package from main in a single operation will also
       remove the source.  This is a particular problem if the source package also builds binary packages that are intended for main, e.g. dbus.

Copyright and Licence
	Copyright (C) 2009  Neil Williams <codehelp@debian.org>

	This package is free software; you can redistribute it and/or modify
	it under the terms of the GNU General Public License as published by
	the Free Software Foundation; either version 3 of the License, or
	(at your option) any later version.

	This program is distributed in the hope that it will be useful,
	but WITHOUT ANY WARRANTY; without even the implied warranty of
	MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
	GNU General Public License for more details.

	You should have received a copy of the GNU General Public License
	along with this program.  If not, see <http://www.gnu.org/licenses/>.

perl v5.12.3							    2011-03-27							   EMGRIP-DUPES(1)
All times are GMT -4. The time now is 05:52 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy