Sponsored Content
Top Forums Shell Programming and Scripting To Find Duplicate files using latest in Linux Post 303007620 by gold2k8 on Sunday 19th of November 2017 12:59:29 AM
Old 11-19-2017
Script for removing the Duplicate files except latest in filename series

I have a folder with series of filename patterns like the below.
Code:
./ARCZ00300_010117_1504690829222.xml
./ARCZ00300_010117_1507101655366.xml [latest]
./ARCZ00301_010117_1504691829478.xml
./ARCZ00301_010117_1507101655591.xml  [latest]
./ARCZ00302_010117_1504691451495.xml
./ARCZ00302_010117_1507101656182.xml  [latest]
./ARCZ00303_010117_1504691526615.xml
./ARCZ00303_010117_1507101657147.xml  [latest]
./ARCZ00304_010117_1504691981689.xml
./ARCZ00304_010117_1507101657249.xml  [latest]
./ARCZ00305_010117_1507101657610.xml
./ARCZ00306_010117_1507101658585.xml
./ARCZ00307_010117_1504691981668.xml
./ARCZ00307_010117_1507101658940.xml  [latest]
./ARCZ00577_010117_1504692004529.xml
./ARCZ00580_010117_1504691562602.xml
./ARCZ00580_010117_1507101892930.xml  [latest]


Script has to pick latest file in all the filename patterns in the folder and it should compare and delete the duplicates.

Appreciate if you can help me with this logic.

Thanks much!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

shell script to find latest date and time of the files

Hi everyone, Please help:) I have a list of 1000 different files which comes daily to the directory.Some of the files are not coming to the directory now. I need to write a shell script to find the latest date and time of the files they came to the directory. The files should be unique.... (1 Reply)
Discussion started by: karthicss
1 Replies

2. UNIX for Dummies Questions & Answers

How to find the latest file on Unix or Linux

Please help me out how to identify the latest file in one directory by looking at file's timestamp or datestamp. You can say using system command. Thanks (10 Replies)
Discussion started by: duke0001
10 Replies

3. Shell Programming and Scripting

Find Duplicate files, not by name

I have a directory with images: -rw-r--r-- 1 root root 26216 Mar 19 21:00 020109.210001.jpg -rw-r--r-- 1 root root 21760 Mar 19 21:15 020109.211502.jpg -rw-r--r-- 1 root root 23144 Mar 19 21:30 020109.213002.jpg -rw-r--r-- 1 root root 31350 Mar 20 00:45 020109.004501.jpg -rw-r--r-- 1 root... (2 Replies)
Discussion started by: Ikon
2 Replies

4. Shell Programming and Scripting

find the latest files in multiple directory

I want to get the latest files from multiple directories, d1, d2,d3 and d4 under the parent dierectoy d. can anyone help out with this? thx (3 Replies)
Discussion started by: shyork2001
3 Replies

5. Shell Programming and Scripting

Find duplicate files

What utility do you recommend for simply finding all duplicate files among all files? (4 Replies)
Discussion started by: kiasas
4 Replies

6. Shell Programming and Scripting

Find the latest directory and loop through the files and pick the error messages

Hi, I am new to unix and shell scripting,can anybody help me in sctipting a requirement. my requirement is to get the latest directory the name of the directory will be like CSB.monthdate_time stamp like CSB.Sep29_11:16 and CSB.Oct01_16:21. i need to pick the latest directory. in the... (15 Replies)
Discussion started by: sudhir_83k
15 Replies

7. Shell Programming and Scripting

How to find the latest file on Unix or Linux (recursive)

Hi all, I need to get the latest file. I have found this command "ls -lrt" that is great but not recursive. Can anyone help? Thanx by advance. (7 Replies)
Discussion started by: 1or2is3
7 Replies

8. Shell Programming and Scripting

Find duplicate files but with different extensions

Hi ! I wonder if anyone can help on this : I have a directory: /xyz that has the following files: chsLog.107.20130603.gz chsLog.115.20130603 chsLog.111.20130603.gz chsLog.107.20130603 chsLog.115.20130603.gz As you ca see there are two files that are the same but only with a minor... (10 Replies)
Discussion started by: fretagi
10 Replies

9. Shell Programming and Scripting

How to find duplicate line in Linux?

Hi, Gurus, I need find the duplicate record in unix file. what command I should use for this. Thanks in advance (4 Replies)
Discussion started by: ken6503
4 Replies

10. UNIX for Beginners Questions & Answers

Modified or latest files copy from windows to Linux

To copy the file from windows to linux i use pscp command(pscp source user@destination). Know i want to copy the latest modified or created files from windows to linux. could any one please help me out with it. Thanks and Regards, Sourabh (2 Replies)
Discussion started by: SourabhChavan
2 Replies
cdde.xml(5)															       cdde.xml(5)

NAME
cdde.xml - Configuration file for cdde DESCRIPTION
When cdde is run for the first time, an example xml configuration file (~/.cdde.xml) is created for you: <?xml version="1.0"?> <cdde delay="5000000"> <drive path="/dev/cdrom"> <audio command="echo An audio cd was inserted."/> <data command="echo A data cd was inserted."/> <dvd command="echo A dvd was inserted."/> <vcd command="echo A vcd was inserted."/> <svcd command="echo A svcd was inserted."/> <blank command="echo A blank cdr/dvdr was inserted."/> <mixed command="echo A mixed (audio/data) cd was inserted."/> </drive> </cdde> This default file is not very useful, and so I suggest you to edit it to your needs before running cdde again. You may add as many drive entries, or commands as you like. If multiple entries are found for a type of disc then all entries will be run in the order they are found. The specific device in use can be passed to the command with one of the following special tags: %dev% - is replaced with the device name of the cdrom that just had a disc inserted %mnt% - is replaced with the listed mount point for the cdrom that just had a disc inserted Note: %mnt% is determined through your fstab (usually located in /etc) file. If you do not have a listing for each <drive> in the fstab this will cause problems. This way, you can tell your video player which device to use when playing a VCD, for example. EXAMPLE
This is an example of ~/.cdde.xml file: <?xml version="1.0"?> <cdde delay="5000000"> <drive path="/dev/cdroms/cdrom0"/> <audio command="xmms %mnt%"/> <data command="mount %mnt%"/> <dvd command="xterm -iconic -e mplayer -fs -xineramascreen 1 -dvd 1"/> <vcd command="xterm -iconic -e mplayer -fs -xineramascreen 1 -vcd 1"/> <svcd command="xterm -iconic -e mplayer -fs -xineramascreen 1 -vcd 1"/> <blank command="gcombust"/> <mixed command="mount %mnt%"/> </drive> </cdde> FILES
~/.cdde.xml SEE ALSO
cdde(1) AUTHORS
Eric Lathrop <eric@ericlathrop.com> Stanislav Maslovski <stanislav.maslovski@gmail.com> WEBSITE
For the latest release of cdde, see: http://cdde.sourceforge.net/ Eric Lathrop 0.3.1 cdde.xml(5)
All times are GMT -4. The time now is 05:41 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy