Sponsored Content
Top Forums Shell Programming and Scripting Deleting extra files with similar filenames Post 302358204 by Scrutinizer on Thursday 1st of October 2009 04:31:07 PM
Old 10-01-2009
OK, that is quite a different requirement Smilie. Assuming the duplicates always have " 1" at the end, followed by the extension ".dat", you could try this ksh/bash code:

Code:
BASEDIR='/path/to/dir'
ext='.dat'
duplext=' 1'
find "$BASEDIR" -type d | while read dir; do
  find $dir -name "*$ext" -maxdepth 1 -type f | while read file; do
    duplicate="${file%$ext}$duplext$ext"
    if [[ -f "$duplicate" ]]; then
      rm "$duplicate"
    fi
  done
done


Last edited by Scrutinizer; 10-01-2009 at 05:36 PM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Appending text to a number of similar filenames

Hi, I was wondering if there was a way to append something to filenames based on a wildcard. For example, if I have the following files in a directory: blah1 blah2 blah3 blah4 blah5 I want to rename these all to: blah1.txt blah2.txt blah3.txt blah4.txt blah5.txt Is there a... (4 Replies)
Discussion started by: Djaunl
4 Replies

2. Shell Programming and Scripting

Deleting the similar lines

Dear Friends myself Avinash working in bash shell The problem goes like this I have a file called work.txt assume that first colum=mac address second colum= IP third colum = port number ---------------------------------------- 00:12:23:34 192.168.50.1 2 00:12:23:35 192.168.50.1 5... (2 Replies)
Discussion started by: avi.skynet
2 Replies

3. Shell Programming and Scripting

csh script for deleting extra spaces in text file

I am new to scripting and I needed to know if there would be an easy way to delete extra spaces in a text file. I have a file with three rows with 22 numbers each, but there is extra spaces between the numbers when it gets output by this program AFNI that I am using. What script would help delete... (2 Replies)
Discussion started by: hertingm
2 Replies

4. Shell Programming and Scripting

removing extra files in dos

Hi, I have same file by name i want to keep only access file and want to delete rest. This is specific to DOS only. Any idea of doing this. I tried so many options but none worked for me. Thanks Namish (11 Replies)
Discussion started by: namishtiwari
11 Replies

5. Shell Programming and Scripting

compare the similar files

I got many pair files, which only have small difference, such as more space, or more empty line, and some unreadable characters. If list by commend "diff", I can see many many difference. So I'd like to write a script to compare the pair files, if 95% contents are same, I will think they are... (2 Replies)
Discussion started by: rdcwayx
2 Replies

6. Shell Programming and Scripting

What extra Parameters I can use for archiving log files

Hello All, I have developed a script which takes following parameter from the input file to archive log files 1)Input Path 2)File pattern(*.csv) 3)Number of days(+1) Following is the algorithm of my script Read the input file go to that path and search for particular n days older... (3 Replies)
Discussion started by: mitsyjohn
3 Replies

7. Shell Programming and Scripting

How to find similar values in different files

Hello, I have 4 files like this: file1: cg24163616 15 297 cg09335911 123 297 cg13515808 565 776 cg12242345 499 705 cg22905282 225 427 cg16674860 286 779 cg14251734 303 724 cg19316579 211 717 cg00612625 422 643 file2:... (2 Replies)
Discussion started by: linseyr
2 Replies

8. Shell Programming and Scripting

Looking to find files that are similar.

Hello all, I have a server that is running AIX, running a tool that converts various printstreams (AFP/Metadata) to PDF. This is done using a rexx script and an off the shelf utility. Each report (there's around 125) uses a certain script file, it's basically a text file. I am trying... (5 Replies)
Discussion started by: jeffs42885
5 Replies

9. UNIX for Dummies Questions & Answers

Sorting files using extra buffer

i want to sort a file which was 4gb of data. my ram sixe was 2gb. so, i want to sort that file using extra buffer , is it possible in unix? if possible plz help me thanks (3 Replies)
Discussion started by: mahesh1987
3 Replies

10. Solaris

Getting similar lines in two files

Hi, I need to compare the /etc/passwd files from 2 servers, and extract the users that are similar in these two files. I sorted the 2 files based on the user IDs (UID) (3rd column). I first sorted the files using the username (1st column), however when I use comm to compare the files there is no... (1 Reply)
Discussion started by: anaigini45
1 Replies
ASP(1)								    User Manual 							    ASP(1)

NAME
asp - find an host IP address by its name SYNOPSIS
asp [-uv] [-f | [-d dir] [-e ext]] [-a addresses] [-r repetitions] [-s send_delay] [-w wait_time] [-p port] hostname asp -V DESCRIPTION
Asp finds the IP address of an Internet connected host. In order to find it, the peer hostname (not the FQDN), and the range of its possi- ble IP addresses need to be specified. Those IP addresses could be simple IP addresses as 127.0.0.1 or "metaip" addresses as 127.0.0.1-20 or 127.0.0.*: the former is a simple way to avoid to type a lot of consecutive addresses, the latter is short for 127.0.0.1-254. In order to simplify the management of the associations between hostnames and addresses, asp searches in a specified directory a text file containing the possible IP addresses of the looked for host. The name of the text file has to be formed by the hostname followed by an optional extension of your choice. For example to find the author's dynamic IP address, obviously if I am on line, you can provide my metaip address on standard input with the command: echo "195.31.186.1-62 194.166.58.2-18" | asp -f atomic or you can put my metaip address in a file called atomic in your ~/.asp directory, like this: echo "195.31.186.1-62 194.166.58.2-18" > ~/.asp/atomic and then you can simply do: asp atomic OPTIONS
-u Update the file /etc/hosts with the IP address of hostname or delete the possible old entry if the address is not found. Obviously the file have to by writable by the user. -v Include more verbiage to make output readable by humans. Default consists only of dotted quad IP address, which is intended for output substitution in scripts. -f Force the reading of addresses from standard input instead that from the hostname's file. -d dir Set the directory containing the addresses file referred by hostname to dir. Default is ~/.asp. -e ext Set addresses files extension to ext. Default is no extension. -a addresses Set the number of queries to send before make a pause of send_delay seconds. Default is 12 queries. -r repetitions Set the number of times to try the same address. Default is 3 times. -s send_delay Delay the sending of the next group of addresses send_delay seconds. Default is 2 seconds. -w wait_time Wait the peer reply for wait_time seconds. Default is 5 seconds. -p port Specify an alternative port number. For default the port number is obtained searching the asp entry in /etc/services. -V Show version information. ENVIRONMENT
ASPCMD This variable could be used to store your preferred settings. An option set in this environment variable could be overridden or tog- gled from command line. BUGS
UDP is an unreliable protocol, therefore there is a chance you will not find the host even if it is on line. Anyway, if you are sure that the peer is on line and asp aware, you could adjust the various parameters until you get a reply. At last you will find the correct set- tings for your particular needs. This until the RDM communication style will be implemented under Linux. Obviously the hostname has to be unique among the possible IP addresses: asp will hook to the first correct reply. AUTHOR
Stenio Brunetta <stenio@brunettaeperin.it> Comments and suggestions are welcome. ACKNOWLEDGMENTS
Steven N. Hirsch <shirsch@ibm.net> for v1.3 bug fix and for the verbose option. Colin Phipps <cphipps@doomworld.com> for the tmpnam security issue. SEE ALSO
aspd(8). Linux February 1997 ASP(1)
All times are GMT -4. The time now is 01:38 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy