02-03-2010
Remove duplicate files in same directory
Hi all.
Am doing continuous backup of mailboxes using rsync.
So whenever a new mail arrives it is automatically copied on backup server.
When a new mail arrives it is named as
xyz:2, when it is read by the email client an S is appended
xyz:2,S
Eventually , 2 copies of the same file exist on the backup server with different names while on the Mailserver only
xyz:2,S exists.
e.g
on mail server:
xyz:2,RS
on backup server:
xyz:2,
xyz:2,S
xyz:2,RS
So in 1 directory i can have 3 copies of file
xyz & 2 copies of file
abc.
Can anyone help how i can remove the oldest files(
xyz:2,) and keep only the most recent one on the backup server ?
Thanks
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi ppl.
I have to check for duplicate files in a directory .
the directory has following files
/the/folder /containing/the/file
a1.yyyymmddhhmmss
a1.yyyyMMddhhmmss
b1.yyyymmddhhmmss
b2.yyyymmddhhmmss
c.yyyymmddhhmmss
d.yyyymmddhhmmss
d.yyyymmddhhmmss
where the date time stamp can be... (1 Reply)
Discussion started by: asinha63
1 Replies
2. Shell Programming and Scripting
I need help with a script which accepts one argument and goes through all the files under a directory and prints a list of possible duplicate files As its output, it prints zero or more lines, each one containing a space-separated list of filenames. All the files listed on one line have the same... (1 Reply)
Discussion started by: trueman82
1 Replies
3. Shell Programming and Scripting
Hi,
is it possible to remove all duplicate lines from all txt files in a specific folder?
This is too hard for me maybe someone could help.
lets say we have an amount of textfiles 1 or 2 or 3 or... maximum 50
each textfile has lines with text.
I want all lines of all textfiles... (8 Replies)
Discussion started by: lowmaster
8 Replies
4. Shell Programming and Scripting
Hi
I have been struggling with a script for removing duplicate messages from a shared mailbox.
I would like to search for duplicate messages based on the “Message-ID” string within the messages files.
I have managed to find the duplicate “Message-ID” strings and (if I would like) delete... (1 Reply)
Discussion started by: spangberg
1 Replies
5. Shell Programming and Scripting
Hello,
I wrote a basic script that works however I am was wondering if it could be sped up. I am comparing files over ssh to remove the file from the source server directory if a match occurs. Please Advise me on my mistakes.
#!/bin/bash
for file in `ls /export/home/podcast2/"$1" ` ; do
... (5 Replies)
Discussion started by: jaysunn
5 Replies
6. Shell Programming and Scripting
Dear All,
I have multiple files having number of records, consist of more than 10 columns some column values are duplicate and i want to remove these duplicate values from these files.
Duplicate values may come in different files.... all files laying in single directory..
Need help to... (3 Replies)
Discussion started by: arvindng
3 Replies
7. Shell Programming and Scripting
Hello again, I am wanting to remove all duplicate blocks of XML code in a file. This is an example:
input:
<string-array name="threeItems">
<item>item1</item>
<item>item2</item>
<item>item3</item>
</string-array>
<string-array name="twoItems">
<item>item1</item>
<item>item2</item>... (19 Replies)
Discussion started by: raidzero
19 Replies
8. Shell Programming and Scripting
Hi,
In a directory, e.g. ~/corpus is a lot of files and subdirectories. Some of the files are named:
12345___PP___0902___AA.txt
12346___PP___0902___AA. txt
12347___PP___0902___AA. txt
The amount of files varies. I need to keep the highest (12347___PP___0902___AA. txt) and remove... (5 Replies)
Discussion started by: corfuitl
5 Replies
9. Windows & DOS: Issues & Discussions
So, I have text files,
one "fail.txt"
And one
"color.txt"
I now want to use a command line (DOS) to remove ANY line that is PRESENT IN BOTH from each text file.
Afterwards there shall be no duplicate lines. (1 Reply)
Discussion started by: pasc
1 Replies
10. Shell Programming and Scripting
TARGET_DIR='/media/andy/MAXTOR_SDB1/Ubuntu_Mate_18.04/'
REGEX='{4}-{2}-{2}_{2}:{2}' # regular expression that match to: date '+%Y-%m-%d_%H:%M'
LATEST_FILE="$(ls "$TARGET_DIR" | egrep "^${REGEX}$" | tail -1)"
find "$TARGET_DIR" ! -name "$LATEST_FILE" -type f -regextype egrep -regex... (7 Replies)
Discussion started by: drew77
7 Replies
BIFF(1) BSD General Commands Manual BIFF(1)
NAME
biff -- be notified if mail arrives and who it is from
SYNOPSIS
biff [n | y | b]
DESCRIPTION
The biff utility informs the system whether you want to be notified on your terminal when mail arrives.
Affected is the first terminal associated with the standard input, standard output or standard error file descriptor, in that order. Thus,
it is possible to use the redirection facilities of a shell to toggle the notification for other terminals than the one biff runs on.
The following options are available:
n Disable notification.
y Enable header notification.
b Enable bell notification.
When header notification is enabled, the header and first few lines of the message will be printed on your terminal whenever mail arrives. A
``biff y'' command is often included in the file .login or .profile to be executed at each login.
When bell notification is enabled, only two bell characters (ASCII 07) will be printed on your terminal whenever mail arrives.
If no arguments are given, biff displays the present notification status of the terminal to the standard output.
The biff utility operates asynchronously. For synchronous notification use the MAIL variable of sh(1) or the mail variable of csh(1).
DIAGNOSTICS
The biff utility exits with one of the following values:
0 Notification is enabled.
1 Notification is disabled.
>1 An error occurred.
COMPATIBILITY
Previous versions of the biff utility affected the terminal attached to standard error without first trying the standard input or output
devices.
SEE ALSO
csh(1), mail(1), sh(1), comsat(8)
HISTORY
The biff command appeared in 4.0BSD. It was named after the dog of Heidi Stettner. He died in August 1993, at 15.
BSD
July 9, 2002 BSD