Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Remove duplicate files
Top Forums Shell Programming and Scripting Remove duplicate files Post 302613377 by Skrynesaver on Tuesday 27th of March 2012 07:10:26 AM
Old 03-27-2012
Yes, it's bash.
You could certainly use \*.txt in the find command
If you need to build a list of not the highest or lowest you could use an array or a temp file and set the first to be both highest and lowest
The rm command should be replaced writing the names of the files to be moved to your array/temp file
Then post process with a mv command for everything in the array / temp file , possibly recreating any directory structure underneath with a mkdir -p $new_dir/$(basenaname $i)
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicate files in a directory

Hi ppl. I have to check for duplicate files in a directory . the directory has following files /the/folder /containing/the/file a1.yyyymmddhhmmss a1.yyyyMMddhhmmss b1.yyyymmddhhmmss b2.yyyymmddhhmmss c.yyyymmddhhmmss d.yyyymmddhhmmss d.yyyymmddhhmmss where the date time stamp can be... (1 Reply)
Discussion started by: asinha63
1 Replies

2. Shell Programming and Scripting

remove all duplicate lines from all files in one folder

Hi, is it possible to remove all duplicate lines from all txt files in a specific folder? This is too hard for me maybe someone could help. lets say we have an amount of textfiles 1 or 2 or 3 or... maximum 50 each textfile has lines with text. I want all lines of all textfiles... (8 Replies)
Discussion started by: lowmaster
8 Replies

3. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete... (1 Reply)
Discussion started by: spangberg
1 Replies

4. Shell Programming and Scripting

remove duplicate

Hi, I am tryung to use shell or perl to remove duplicate characters for example , if I have " I love google" it will become I love ggle" or even "I loveggle" if removing duplicate white space Thanks CC (6 Replies)
Discussion started by: ccp
6 Replies

5. Shell Programming and Scripting

Remove duplicate files in same directory

Hi all. Am doing continuous backup of mailboxes using rsync. So whenever a new mail arrives it is automatically copied on backup server. When a new mail arrives it is named as xyz:2, when it is read by the email client an S is appended xyz:2,S Eventually , 2 copies of the same file exist on... (7 Replies)
Discussion started by: coolatt
7 Replies

6. Shell Programming and Scripting

Remove Duplicate Files On Remote Servers

Hello, I wrote a basic script that works however I am was wondering if it could be sped up. I am comparing files over ssh to remove the file from the source server directory if a match occurs. Please Advise me on my mistakes. #!/bin/bash for file in `ls /export/home/podcast2/"$1" ` ; do ... (5 Replies)
Discussion started by: jaysunn
5 Replies

7. Shell Programming and Scripting

perl/shell need help to remove duplicate lines from files

Dear All, I have multiple files having number of records, consist of more than 10 columns some column values are duplicate and i want to remove these duplicate values from these files. Duplicate values may come in different files.... all files laying in single directory.. Need help to... (3 Replies)
Discussion started by: arvindng
3 Replies

8. Shell Programming and Scripting

[uniq + awk?] How to remove duplicate blocks of lines in files?

Hello again, I am wanting to remove all duplicate blocks of XML code in a file. This is an example: input: <string-array name="threeItems"> <item>item1</item> <item>item2</item> <item>item3</item> </string-array> <string-array name="twoItems"> <item>item1</item> <item>item2</item>... (19 Replies)
Discussion started by: raidzero
19 Replies

9. Windows & DOS: Issues & Discussions

Remove duplicate lines from text files.

So, I have text files, one "fail.txt" And one "color.txt" I now want to use a command line (DOS) to remove ANY line that is PRESENT IN BOTH from each text file. Afterwards there shall be no duplicate lines. (1 Reply)
Discussion started by: pasc
1 Replies

10. Shell Programming and Scripting

Remove all but newest two files (Not a duplicate post)

TARGET_DIR='/media/andy/MAXTOR_SDB1/Ubuntu_Mate_18.04/' REGEX='{4}-{2}-{2}_{2}:{2}' # regular expression that match to: date '+%Y-%m-%d_%H:%M' LATEST_FILE="$(ls "$TARGET_DIR" | egrep "^${REGEX}$" | tail -1)" find "$TARGET_DIR" ! -name "$LATEST_FILE" -type f -regextype egrep -regex... (7 Replies)
Discussion started by: drew77
7 Replies

LEARN ABOUT XFREE86

mkcfm

MKCFM(1)						      General Commands Manual							  MKCFM(1)

NAME

       mkcfm - create summaries of font metric files in CID font directories

SYNOPSIS

       mkcfm [CID-font-directory-name]

DESCRIPTION

       There  is  usually only one CID font directory on the X font path. It is usually called /usr/X11R6/lib/X11/fonts/CID. If you do not specify
       an argument, mkcfm will try to go through the subdirectories of that directory, and create one summary of font metric files for	each  CID-
       Font (character descriptions) file and each CMap (Character Maps) file it finds. The summaries of font metric files are put in the existing
       CFM subdirectory. The CFM subdirectories are created when CID-keyed fonts are installed.

       If you specify a CID font directory as an argument, mkcfm will try to go through the subdirectories of that directory, and create one  sum-
       mary  of  font metric files for each CIDFont file and each CMap file it finds.  mkcfm will calculate the summaries of the font metric files
       stored in AFM subdirectories of the CID font directory.

       Those summaries are needed by the rasterizer of CID-keyed fonts to speed up the response to X font calls. If those files do not exist,  CID
       rasterizer  will  have  to go through usually large font metric files, and calculate the summaries itself each time the font is called. You
       will notice a substantial wait on a call to a large CID-keyed font.

FILES

       .afm files     Each CID-keyed font file is supposed to have a font metric file (.afm file). mkcfm creates summary  files  (.cfm	files)	of
		      those  font metric files. mkcfm should be run whenever a change is made to the files stored in the subdirectories of the CID
		      font directory. For example, it should be run when new CID fonts are installed.

       .cfm files     Summaries of font metric (.afm) files created by mkcfm.

SEE ALSO

       The rasterizer for CID-keyed fonts in the directory xc/lib/font/Type1.

CID Fonts Version 1.0						    Release 1.0 							  MKCFM(1)
All times are GMT -4. The time now is 09:27 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy