Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Remove duplicate files in same directory
Top Forums Shell Programming and Scripting Remove duplicate files in same directory Post 302392023 by coolatt on Wednesday 3rd of February 2010 07:39:32 AM
Old 02-03-2010
Quote:
Originally Posted by rdcwayx
rsync with -e --delete?

Code:
     --delete                delete extraneous files from dest dirs

If a mail file is deleted from the mail server , using --delete will delete on backup server as well.
Am running rsync regularly & files on backup server are deleted by a script only if they have a certain age e.g 10days

Smilie

---------- Post updated at 06:39 PM ---------- Previous update was at 05:58 PM ----------
Quote:
Originally Posted by Anu_1
I am very new in unix but will it help if you use..
ls -rt| tail -1 ==> this will get you the most current file
I tried on the following files:

Quote:
1265199975.P6583Q0M174865.ecs,S=623:2,S
1265199975.P6583Q0M174865.ecs,S=623:2,F
1265199975.P6583Q0M174865.ecs,S=623:2,
1265198625.P6233Q0M875762.ecs,S=639:2,F
1265198625.P6233Q0M875762.ecs,S=639:2,FS
1265198625.P6233Q0M875762.ecs,S=639:2,S
Output is:
Quote:
1265199975.P6583Q0M174865.ecs,S=623:2,
Still ... Smilie

Anyone plz help me.thx.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicate files in a directory

Hi ppl. I have to check for duplicate files in a directory . the directory has following files /the/folder /containing/the/file a1.yyyymmddhhmmss a1.yyyyMMddhhmmss b1.yyyymmddhhmmss b2.yyyymmddhhmmss c.yyyymmddhhmmss d.yyyymmddhhmmss d.yyyymmddhhmmss where the date time stamp can be... (1 Reply)
Discussion started by: asinha63
1 Replies

2. Shell Programming and Scripting

script that detects duplicate files in directory

I need help with a script which accepts one argument and goes through all the files under a directory and prints a list of possible duplicate files As its output, it prints zero or more lines, each one containing a space-separated list of filenames. All the files listed on one line have the same... (1 Reply)
Discussion started by: trueman82
1 Replies

3. Shell Programming and Scripting

remove all duplicate lines from all files in one folder

Hi, is it possible to remove all duplicate lines from all txt files in a specific folder? This is too hard for me maybe someone could help. lets say we have an amount of textfiles 1 or 2 or 3 or... maximum 50 each textfile has lines with text. I want all lines of all textfiles... (8 Replies)
Discussion started by: lowmaster
8 Replies

4. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete... (1 Reply)
Discussion started by: spangberg
1 Replies

5. Shell Programming and Scripting

Remove Duplicate Files On Remote Servers

Hello, I wrote a basic script that works however I am was wondering if it could be sped up. I am comparing files over ssh to remove the file from the source server directory if a match occurs. Please Advise me on my mistakes. #!/bin/bash for file in `ls /export/home/podcast2/"$1" ` ; do ... (5 Replies)
Discussion started by: jaysunn
5 Replies

6. Shell Programming and Scripting

perl/shell need help to remove duplicate lines from files

Dear All, I have multiple files having number of records, consist of more than 10 columns some column values are duplicate and i want to remove these duplicate values from these files. Duplicate values may come in different files.... all files laying in single directory.. Need help to... (3 Replies)
Discussion started by: arvindng
3 Replies

7. Shell Programming and Scripting

[uniq + awk?] How to remove duplicate blocks of lines in files?

Hello again, I am wanting to remove all duplicate blocks of XML code in a file. This is an example: input: <string-array name="threeItems"> <item>item1</item> <item>item2</item> <item>item3</item> </string-array> <string-array name="twoItems"> <item>item1</item> <item>item2</item>... (19 Replies)
Discussion started by: raidzero
19 Replies

8. Shell Programming and Scripting

Remove duplicate files

Hi, In a directory, e.g. ~/corpus is a lot of files and subdirectories. Some of the files are named: 12345___PP___0902___AA.txt 12346___PP___0902___AA. txt 12347___PP___0902___AA. txt The amount of files varies. I need to keep the highest (12347___PP___0902___AA. txt) and remove... (5 Replies)
Discussion started by: corfuitl
5 Replies

9. Windows & DOS: Issues & Discussions

Remove duplicate lines from text files.

So, I have text files, one "fail.txt" And one "color.txt" I now want to use a command line (DOS) to remove ANY line that is PRESENT IN BOTH from each text file. Afterwards there shall be no duplicate lines. (1 Reply)
Discussion started by: pasc
1 Replies

10. Shell Programming and Scripting

Remove all but newest two files (Not a duplicate post)

TARGET_DIR='/media/andy/MAXTOR_SDB1/Ubuntu_Mate_18.04/' REGEX='{4}-{2}-{2}_{2}:{2}' # regular expression that match to: date '+%Y-%m-%d_%H:%M' LATEST_FILE="$(ls "$TARGET_DIR" | egrep "^${REGEX}$" | tail -1)" find "$TARGET_DIR" ! -name "$LATEST_FILE" -type f -regextype egrep -regex... (7 Replies)
Discussion started by: drew77
7 Replies

LEARN ABOUT SUNOS

asadmin-delete-javamail-resource

asadmin-delete-javamail-resource(1AS)				   User Commands			     asadmin-delete-javamail-resource(1AS)

NAME

       delete-javamail-resource  - removes the JavaMail resource

SYNOPSIS

       delete-javamail-resource  --user admin_user [--password admin_password] [--host localhost][--port 4848] [--secure|-s] [--passwordfile file-
       name] [--terse=false] [--echo=false] [--interactive] jndi_name

       Removes the JavaMail resource. This command is supported in remote mode only.

OPTIONS

       --user		       authorized domain application server administrative username.

       --password	       password to administer the domain application server.

       --host		       machine name where the domain application server is running.

       --port		       port number of the domain application server listening for administration requests.

       --secure 	       if true, uses SSL/TLS to communicate with the domain application server.

       --passwordfile	       file containing the domain application server password.

       --terse		       indicates that any output data must be very concise, typically avoiding human-friendly sentences and favoring well-
			       formatted data for consumption by a script.

       --echo		       setting to true will echo the command line statement on the standard output.

       --interactive	       prompts you for the required options that are not already specified.

OPERANDS

       jndi_name	       JNDI name of the JavaMail resource to be deleted.

       Example 1: Using delete-javamail-resource

       asadmin> delete-javamail-resource --user admin
       --password adminadmin --host fuyako --port 7070 mail/MyMailSession
       Command delete-javamail-resource executed successfully

       Where: mail/MyMailSession is the JavaMail resource deleted.

EXIT STATUS

       0		       command executed successfully

       1		       error in executing the command

       asadmin-create-javamail-resource(1AS), asadmin-list-javamail-resources(1AS)

J2EE 1.4 SDK							    March 2004				     asadmin-delete-javamail-resource(1AS)
All times are GMT -4. The time now is 09:56 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy