Remove duplicate files Post: 302613347

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicate files in a directory

Hi ppl. I have to check for duplicate files in a directory . the directory has following files /the/folder /containing/the/file a1.yyyymmddhhmmss a1.yyyyMMddhhmmss b1.yyyymmddhhmmss b2.yyyymmddhhmmss c.yyyymmddhhmmss d.yyyymmddhhmmss d.yyyymmddhhmmss where the date time stamp can be...

2. Shell Programming and Scripting

remove all duplicate lines from all files in one folder

Hi, is it possible to remove all duplicate lines from all txt files in a specific folder? This is too hard for me maybe someone could help. lets say we have an amount of textfiles 1 or 2 or 3 or... maximum 50 each textfile has lines with text. I want all lines of all textfiles...

3. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete...

4. Shell Programming and Scripting

remove duplicate

Hi, I am tryung to use shell or perl to remove duplicate characters for example , if I have " I love google" it will become I love ggle" or even "I loveggle" if removing duplicate white space Thanks CC

5. Shell Programming and Scripting

Remove duplicate files in same directory

Hi all. Am doing continuous backup of mailboxes using rsync. So whenever a new mail arrives it is automatically copied on backup server. When a new mail arrives it is named as xyz:2, when it is read by the email client an S is appended xyz:2,S Eventually , 2 copies of the same file exist on...

6. Shell Programming and Scripting

Remove Duplicate Files On Remote Servers

Hello, I wrote a basic script that works however I am was wondering if it could be sped up. I am comparing files over ssh to remove the file from the source server directory if a match occurs. Please Advise me on my mistakes. #!/bin/bash for file in `ls /export/home/podcast2/"$1" ` ; do ...

7. Shell Programming and Scripting

perl/shell need help to remove duplicate lines from files

Dear All, I have multiple files having number of records, consist of more than 10 columns some column values are duplicate and i want to remove these duplicate values from these files. Duplicate values may come in different files.... all files laying in single directory.. Need help to...

8. Shell Programming and Scripting

[uniq + awk?] How to remove duplicate blocks of lines in files?

Hello again, I am wanting to remove all duplicate blocks of XML code in a file. This is an example: input: <string-array name="threeItems"> <item>item1</item> <item>item2</item> <item>item3</item> </string-array> <string-array name="twoItems"> <item>item1</item> <item>item2</item>...

9. Windows & DOS: Issues & Discussions

Remove duplicate lines from text files.

So, I have text files, one "fail.txt" And one "color.txt" I now want to use a command line (DOS) to remove ANY line that is PRESENT IN BOTH from each text file. Afterwards there shall be no duplicate lines.

10. Shell Programming and Scripting

Remove all but newest two files (Not a duplicate post)

TARGET_DIR='/media/andy/MAXTOR_SDB1/Ubuntu_Mate_18.04/' REGEX='{4}-{2}-{2}_{2}:{2}' # regular expression that match to: date '+%Y-%m-%d_%H:%M' LATEST_FILE="$(ls "$TARGET_DIR" | egrep "^${REGEX}$" | tail -1)" find "$TARGET_DIR" ! -name "$LATEST_FILE" -type f -regextype egrep -regex...

LEARN ABOUT DEBIAN

atr_analysis

ATR_ANALYSIS(1p)						   User Commands						  ATR_ANALYSIS(1p)

NAME

       ATR_analysis - analyse a smart card ATR

SYNOPSIS

       ATR_analysis [ATRstring]

DESCRIPTION

       ATR_analysis is used to parse the ATR (Answer To Reset) sent by a smart card.

       The command also tries to find the card model using an ATR database stored in a text file smartcard_list.txt.

       The smartcard_list.txt file is searched in ./, /usr/local/pcsc/ and /usr/share/pcsc/ directories.

       Exemple:
	$ ATR_analysis '3B A7 00 40 18 80 65 A2 08 01 01 52'
	ATR: 3B A7 00 40 18 80 65 A2 08 01 01 52
	+ TS = 3B --> Direct Convention
	+ T0 = A7, Y(1): 1010, K: 7 (historical bytes)
	  TB(1) = 00 --> Programming Param P: 0, I: 0
	  TD(1) = 40 --> Y(i+1) = 0100, Protocol T = 0
	-----
	  TC(2) = 18 --> Work waiting time: 960 x 24 x (Fi/F)
	+ Historical bytes: 80 65 A2 08 01 01 52

	Possibly identified card:
	3B A7 00 40 18 80 65 A2 08 01 01 52
	       Gemplus GPK8000

BUGS

       Maybe many bugs since I am not a ISO 7816 expert.

FILES

       smartcard_list.txt

SEE ALSO

       pcscd(8), pcsc_scan(1)

AUTHOR

       Ludovic Rousseau <ludovic.rousseau@free.fr>

Version: 1.3							   October 2005 						  ATR_ANALYSIS(1p)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicate files in a directory

Discussion started by: asinha63

2. Shell Programming and Scripting

remove all duplicate lines from all files in one folder

Discussion started by: lowmaster

3. Shell Programming and Scripting

Remove duplicate files based on text string?

Discussion started by: spangberg

4. Shell Programming and Scripting

remove duplicate

Discussion started by: ccp