Unique files in a given directory


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Unique files in a given directory
# 8  
Old 08-06-2011
After using the script above, to move to a new directory with same paths:

Code:
./cdupes.sh directory1 directory2 | parallel 'file={}; fpatha=${file#*./}; fpath=${fpatha%/*}; mkdir -p "./ToDelete/$fpath"; mv "$file" "./ToDelete/$fpatha"

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Print number of lines for files in directory, also print number of unique lines

I have a directory of files, I can show the number of lines in each file and order them from lowest to highest with: wc -l *|sort 15263 Image.txt 16401 reference.txt 40459 richtexteditor.txt How can I also print the number of unique lines in each file? 15263 1401 Image.txt 16401... (15 Replies)
Discussion started by: spacegoose
15 Replies

2. Shell Programming and Scripting

Directory containing files,Print names of the files in the directory that are exactly same content.

Given a directory containing say a few thousand files, please output a list of all the names of the files in the directory that are exactly the same, i.e. have the same contents. func(a_directory_name) output -> {“matches”: , ... ]} e.g. func(“/home/my/files”) where the directory... (7 Replies)
Discussion started by: anuragpgtgerman
7 Replies

3. Shell Programming and Scripting

Add unique identifier from file to filetype in directory

I am trying to add a unique identifier to two file extensions .bam and .vcf in a directory located at /home/cmccabe/Desktop/index/R_2016_09_21_14_01_15_user_S5-00580-9-Medexome. The identifier is in $2 of the input file. What the code below is attempting to do is strip off the last portion... (21 Replies)
Discussion started by: cmccabe
21 Replies

4. Shell Programming and Scripting

Extract unique files

In a incoming folder i have list of files like below,i want to pick the unique files to process the job. if same file contain more than one then it should pick latest date modified file to process. drwxrwsrwx 2 n308799 infagrp 256 May 20 17:42 Final_Working drwxrwsrwx 2... (1 Reply)
Discussion started by: katakamvivek
1 Replies

5. Shell Programming and Scripting

Looping through entire directory and count unique values

Hello, I`m a complete newbie to coding, please help with this problem. I have multiple files in a directory, I have to loop through the contents of each file and extract number of unique isoforms in that file. Each file is tab delimited and only the line with the first parent (column 3)... (1 Reply)
Discussion started by: ritakadm
1 Replies

6. UNIX for Dummies Questions & Answers

getting unique lines from 2 files

hi i have used comm -13 <(sort 1.txt) <(sort 2.txt) option to get the unique lines that are present in file 2 but not in file 1. but some how i am getting the entire file 2. i would expect few but not all uncommon lines fro my dat. is there anything wrong with the way i used the command? my... (1 Reply)
Discussion started by: anurupa777
1 Replies

7. Shell Programming and Scripting

Find all images, append unique prefix to name and move to different directory

Hi, I have a directory with Multiple subdirectories and 1000s of pictures (jpg) in each directory. The problem is that each directory has a 001.jpg in them. I want to append a unique name (the directory_name)would be fine. and then move them to one main backup directory once they have been... (1 Reply)
Discussion started by: kmaq7621
1 Replies

8. Shell Programming and Scripting

Unique Directory and Folder Deletion Script

Ok, so I just got charged with the task of deleting some 300 user folders in a FTP server to free up some space. I managed to grep and cut the list of user folders to delete into a list of one user folder per line. Example: bob00 jane01 sue03 In the home folder, there are folders a-z, and... (5 Replies)
Discussion started by: b4sher
5 Replies

9. UNIX for Dummies Questions & Answers

To get unique numbers from two files

here i have two files: file 1 1 2 3 4 5 5 6 7 8 9 file 2 4 5 6 6 8 8 (6 Replies)
Discussion started by: i.scientist
6 Replies

10. UNIX for Dummies Questions & Answers

Directory Inode Number Not Unique

Hi, I know that inode for each file is unique, but is it the for the directory? So far I found different directories has the same inode nubmer when you do ls -i, could some one explain why? Thanks a lot. (9 Replies)
Discussion started by: nj302
9 Replies
Login or Register to Ask a Question
scnasdir(1M)						  System Administration Commands					      scnasdir(1M)

NAME
scnasdir - manage the exported directories on a network-attached storage (NAS) device in a Sun Cluster configuration. SYNOPSIS
scnasdir [-H] scnasdir [-a] [-H] [-n] -h device-name [-d directory [-d directory...]] [-f input-file] scnasdir -p [-H] [-h device-name] [-t device-type] scnasdir -r [-H ] [-n ] -h device-name [-d all | -d directory [-d directory...]] [-f input-file] DESCRIPTION
Note - Beginning with the Sun Cluster 3.2 release, Sun Cluster software includes an object-oriented command set. Although Sun Cluster software still supports the original command set, Sun Cluster procedural documentation uses only the object-oriented command set. For more infor- mation about the object-oriented command set, see the Intro(1CL) man page. The scnasdir command manages the exported directories on NAS devices in a Sun Cluster configuration. The device must already have been con- figured in the cluster by using the scnas command. The scnasdir command can be used to add directories to a device's cluster configuration, to remove directories from a device's cluster con- figuration, and to print the directories of a particular device or particular device types. The options in this command are processed in the order in which they are typed on the command line. The scnasdir command can only be run from an active cluster node. The results of running the command are always the same, regardless of the node that is used. All forms of the scnasdir command accept the -H option. Specifying -H displays help information, and all other options are ignored and not executed. Help information is also printed when scnasdir is run without options. You can use this command only in the global zone. OPTIONS
Basic Options The following options are common to all forms of the scnasdir command: -H If this option is specified on the command line at any position, the command prints help information. All other options are ignored and are not executed. Help information is also printed if scnasdir is run with no options. You can use this option only in the global zone. -n If this option is specified on the command line at any position, the scnasdir command only checks the usage and does not write the con- figuration data. If the -n option is specified with the -f option, the scnasdir command displays the data that will be processed for the user to review. The following options modify the basic form and function of the scnasdir command. None of these options can be combined on the same command line. -a Specifies the add form of the scnasdir command. The -a option can be used to add directories into the device's Sun Cluster configura- tion. You can use this option only in the global zone. -p Specifies the print form of the scnasdir command. When no other option is given, this -p option prints a listing of all the directories of all the NAS devices configured in Sun Cluster. This option can be used with additional options to query a particular device or par- ticular types of NAS devices. You can use this option only in the global zone. -r Specifies the remove form of the scnasdir command. The -r option is used to remove all the directories, or the specified directories of a NAS device from its Sun Cluster configuration. You can use this option only in the global zone. Additional Options The following additional options can be combined with one or more of the previously described basic options to manage the directories of a device. The additional options are as follows: -h device-name Use this option to specify the name of the NAS device in the Sun Cluster configuration. The -h option identifies the device and can be used to remotely access the device by using rhs or telnet. This device name must be specified for the add, change, and remove forms of the scnasdir command. -d all | directory Use this option to list the directories (or volumes) exported on the NAS device to be configured into the Sun Cluster. These directo- ries must be created and exported on the device before using the scnasdir command. See the documentation for the NAS device type for procedures for exporting directories. The -d all option can only be accepted by the remove option, -r. The directories must be specified by using either the -d option, or the -f option, for the add and remove forms of the scnasdir com- mand. -f input-file Directories can be placed into a plain text file, one directory per line, and used with the -f option. Leading white spaces and tabs are ignored. Comments begin with an unquoted pound (#) sign, and continue to the next new line. The parser ignores all comments. EXAMPLES
Example 1 Adding Two NAS Storage Device Directories to a Cluster The following scnasdir command adds two directories of a NAS device to the Sun Cluster configuration. # scnasdir -a -h sunnas1 -d /vol/DB1 -d /vol/DB2 Example 2 Removing All of a NAS Storage Device's Directories From a Cluster The following scnasdir command removes all the directories that are configured for a NAS device. # scnasdir -r -h sunnas1 -d all EXIT STATUS
The following exit values are returned: 0 The command executed successfully. nonzero An error has occurred. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWsczu | +-----------------------------+-----------------------------+ |Interface Stability |Evolving | +-----------------------------+-----------------------------+ SEE ALSO
Intro(1CL), clnasdevice(1CL), clquorum(1CL), cluster(1CL), scconf(1M), scnas(1M) Sun Cluster 3.2 10 Sep 2007 scnasdir(1M)