Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Unique files in a given directory

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Unique files in a given directory
# 8  
Old 08-06-2011
After using the script above, to move to a new directory with same paths:

Code:
./cdupes.sh directory1 directory2 | parallel 'file={}; fpatha=${file#*./}; fpath=${fpatha%/*}; mkdir -p "./ToDelete/$fpath"; mv "$file" "./ToDelete/$fpatha"
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Print number of lines for files in directory, also print number of unique lines

I have a directory of files, I can show the number of lines in each file and order them from lowest to highest with: wc -l *|sort 15263 Image.txt 16401 reference.txt 40459 richtexteditor.txt How can I also print the number of unique lines in each file? 15263 1401 Image.txt 16401... (15 Replies)
Discussion started by: spacegoose
15 Replies

2. Shell Programming and Scripting

Directory containing files,Print names of the files in the directory that are exactly same content.

Given a directory containing say a few thousand files, please output a list of all the names of the files in the directory that are exactly the same, i.e. have the same contents. func(a_directory_name) output -> {“matches”: , ... ]} e.g. func(“/home/my/files”) where the directory... (7 Replies)
Discussion started by: anuragpgtgerman
7 Replies

3. Shell Programming and Scripting

Add unique identifier from file to filetype in directory

I am trying to add a unique identifier to two file extensions .bam and .vcf in a directory located at /home/cmccabe/Desktop/index/R_2016_09_21_14_01_15_user_S5-00580-9-Medexome. The identifier is in $2 of the input file. What the code below is attempting to do is strip off the last portion... (21 Replies)
Discussion started by: cmccabe
21 Replies

4. Shell Programming and Scripting

Extract unique files

In a incoming folder i have list of files like below,i want to pick the unique files to process the job. if same file contain more than one then it should pick latest date modified file to process. drwxrwsrwx 2 n308799 infagrp 256 May 20 17:42 Final_Working drwxrwsrwx 2... (1 Reply)
Discussion started by: katakamvivek
1 Replies

5. Shell Programming and Scripting

Looping through entire directory and count unique values

Hello, I`m a complete newbie to coding, please help with this problem. I have multiple files in a directory, I have to loop through the contents of each file and extract number of unique isoforms in that file. Each file is tab delimited and only the line with the first parent (column 3)... (1 Reply)
Discussion started by: ritakadm
1 Replies

6. UNIX for Dummies Questions & Answers

getting unique lines from 2 files

hi i have used comm -13 <(sort 1.txt) <(sort 2.txt) option to get the unique lines that are present in file 2 but not in file 1. but some how i am getting the entire file 2. i would expect few but not all uncommon lines fro my dat. is there anything wrong with the way i used the command? my... (1 Reply)
Discussion started by: anurupa777
1 Replies

7. Shell Programming and Scripting

Find all images, append unique prefix to name and move to different directory

Hi, I have a directory with Multiple subdirectories and 1000s of pictures (jpg) in each directory. The problem is that each directory has a 001.jpg in them. I want to append a unique name (the directory_name)would be fine. and then move them to one main backup directory once they have been... (1 Reply)
Discussion started by: kmaq7621
1 Replies

8. Shell Programming and Scripting

Unique Directory and Folder Deletion Script

Ok, so I just got charged with the task of deleting some 300 user folders in a FTP server to free up some space. I managed to grep and cut the list of user folders to delete into a list of one user folder per line. Example: bob00 jane01 sue03 In the home folder, there are folders a-z, and... (5 Replies)
Discussion started by: b4sher
5 Replies

9. UNIX for Dummies Questions & Answers

To get unique numbers from two files

here i have two files: file 1 1 2 3 4 5 5 6 7 8 9 file 2 4 5 6 6 8 8 (6 Replies)
Discussion started by: i.scientist
6 Replies

10. UNIX for Dummies Questions & Answers

Directory Inode Number Not Unique

Hi, I know that inode for each file is unique, but is it the for the directory? So far I found different directories has the same inode nubmer when you do ls -i, could some one explain why? Thanks a lot. (9 Replies)
Discussion started by: nj302
9 Replies
Login or Register to Ask a Question

LEARN ABOUT ULTRIX

uulog

uucp(1c)																  uucp(1c)

Name
       uucp, uulog, uuname - unix to unix copy

Syntax
       uucp [option...] source-file...	destination-file

       uulog [option...]

       uuname [option...]

Description
       The  command  copies  files  named by the source-file arguments to the destination-file argument.  A file name either may be a path name on
       your machine or may have the form

	      system-name!pathname

       where `system-name' is taken from a list of system names which knows about.  Shell metacharacters ?*[] appearing in the pathname part  will
       be expanded on the appropriate system.

       Pathnames  may  be  a  full  pathname, a pathname preceded by ~user, where user is a userid on the specified system and is replaced by that
       user's login directory, or anything else prefixed by the current directory.

       If the result is an erroneous pathname for the remote system, the copy will fail.  If the destination-file is a directory, the last part of
       the  source-file  name is used.	If a simple ~user destination is inaccessible to data is copied to a spool directory and the user is noti-
       fied by

       The command preserves execute permissions across the transmission and gives 0666 read and write permissions.  For further information, see

Options
       The following options are interpreted by

       -d Creates all necessary directories for the file copy.

       -c Uses the source file when copying out rather than copying the file to the spool directory.

       -m Sends you mail when the copy is complete.

       -nrec
	  Sends mail to the recipient.

       -W Expands only local files.  Normally files names are prepended with the current working directory if a full path is not  specified.   The
	  -W tells to expand local files only.

       The command prints a summary of and transactions that were recorded in the file

       The options cause to print logging information:

       -ssys
	  Displays information about work involving specified system.

       -uuser
	  Displays information about work involving specified user.

       The command lists the uucp names of known systems.

       -l Lists local system name.

Warnings
       The  domain  of	remotely  accessible  files  can (and for obvious security reasons, usually should) be severely restricted.  You will very
       likely not be able to fetch files by pathname.  Ask a responsible person on the remote system to send them to you.  For the  same  reasons,
       you will probably not be able to send files to arbitrary pathnames.

Restrictions
       All files received by will be owned by uucp.
       The  -m	option	will  only work sending files or receiving a single file.  (Receiving multiple files specified by special shell characters
       ?*[] will not activate the -m option.)

Files
       /usr/spool/uucp - spool directory
       /usr/lib/uucp/* - other data and program files
       /etc/acucap - shared autodial modem database

See Also
       mail(1), uux(1c), acucap(5)
       "Uucp Implementation Description," ULTRIX Supplementary Documentation, Vol. III:System Manager

																	  uucp(1c)