Recursive search for files and copy to new directories Post: 302664545

Sponsored Content

Top Forums Shell Programming and Scripting Recursive search for files and copy to new directories Post 302664545 by flyawaymike on Friday 29th of June 2012 06:04:13 PM

06-29-2012

Registered User

Recursive search for files and copy to new directories

So I have extremely limited experience with shell scripting and I was hoping someone could point out a few commands I need to use in order to pull this off with a shell script like BASH or whatnot (this is on OS X).

I need to search out for filenames with account numbers in the name itself (potentially more than one file with an account number plus other characters in the name), and copy them to a temporary folder, either in their own subfolders (named after the account number), or all in the same place. Basically I'm just trying to extract an copy some PDF files out of one location and put them in another. The search of the source location should be a recursive search. The filenames are basically "textstring12345689textstring.pdf"

I had this working at one point a while back using PHP, though it would sometime crap out on me after a larger number of runs through the loop. Regardless, I'd ideally like to just do this in a shell script anyway as the PHP script is pretty slow (it's searching through like a million files in a bunch of folders). Here is basically what I did in PHP:

Code:

<?php

$handle = @fopen('/Users/me/www/nexus/media/encore1.csv', "r");
mkdir ("/Users/me/www/temp");

if ($handle) {
	while (!feof($handle)) {
		$lines[] = fgets($handle);
	}
	fclose($handle);
}

for ($a=0; $a<count($lines); $a++)
{
	$cardnumber = trim($lines[$a]);
	print "\"" . $cardnumber . "\"<br>";
	$searchStr = "find . -name \"*" . $cardnumber . "*\"";
	
	print $searchStr . "<br>";    // just watching the progress
	
	$tempRoot = "/Users/me/www/temp/";
	$tempFolder = $tempRoot . $cardnumber;
	
	if (strlen($cardnumber) >= 16) {
		exec($searchStr, $output, $return);
	
		mkdir($tempFolder);
		
		foreach ( $output as $file) {
	
			$destinationFile = $tempFolder . "/" . basename($file);
			copy($file, $destinationFile);
			print basename($file) . " copied to " . $destinationFile . "<br>";   // again progress check
			
		}
	} else {
		print "Invalid Account Number ";
	}
	unset($output); 
}
?>

Pardon the lack of indentation in that code, it doesn't pass through when pasting in it.

The CSV file is just a single column list of account numbers. I'm sure this can be easily done with some kind of search and copy and make directory commands in a shell script, but I'm not really familiar with any.

Would anyone one have some pointers on which commands that are counterparts to the PHP ones above?

Last edited by flyawaymike; 06-29-2012 at 09:28 PM..

flyawaymike

View Public Profile for flyawaymike

Find all posts by flyawaymike

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

recursive copy of hidden files

I need to know how to copy hidden files recursively? cp -r sourceDir/* targetDir/. ignores the hidden files. Thank you!!

2. UNIX for Dummies Questions & Answers

copy multiple files in different directories

I have a report file that is generated every day by a scheduled process. Each day the file is written to a directory named .../blah_blah/Y07/MM-DD-YY/reportmmddyy.tab I want to copy all of this reports to a separate directory without having to do it one by one. However, if I try cp...

3. Cybersecurity

Recursive search for group or other writeable 'dot' files

I'm looking for a easy way to do a recursive search through a directory structure for all files that begin with '.' that are group or other writable. Any suggestions?

4. Shell Programming and Scripting

Recursive call to find files and directories in Shell script from current path.

################################################################ Copy this script to your path from where you want to search for all the files and directories in subdirectories recursively. ################################################################# code starts here...

5. UNIX for Dummies Questions & Answers

Copy Directories excluding files

Hi guys, I want to copy folder and sub folders only. I don't want the files. If i use cp -r command it will copy entirely with files. Could any one suggest me. Thanks in advance

6. UNIX for Dummies Questions & Answers

how can i copy those files into other directories have the same name

how can i copy those files into other directories have the same name but different in the end i have files in directory called test: 10_10_asdadfsdfad.txt 10_10_11_asdawqefwkjasd.txt 10_10_11_12_asdafjjhoqwd.txt i want to put them in exist directory thart i have on my system i have...

7. Shell Programming and Scripting

Recursive looping through files and directories

hi; i need a script which will go to all directories and subdirectories and print the filenames as follow; here i m printing only files listing in current directory reason i m doing this is coz i want to perform some operations according to filename achieved so cant use find command;...

8. Shell Programming and Scripting

recursive search and copy

Hello again. Well, I need help again sooner as I thought. Now I want to search for files with a known name within all subdirs, and copy the to differently named files in the same directory. For example if I had only one file to copy, I would just usecp fileName newFileNamebut to do this...

9. HP-UX

Recursive copy of Folders with files

Dear All, I will appreciate any help received. Our system is running on hpux v1 My problem is as follows: We have many customer folders with name fd000100, fd000101 and so on e.g. (Testrun)(testsqa):/>ll /TESTrun/fd000100 total 48 drwxrwx--- 2 fq000100 test 96 Jun 27 2004...

10. Shell Programming and Scripting

Copy files in respective directories

Hi Guys, I need to copy the files to respective directories based on name of the file. My script is something like below con=$1 for file in `cat $con` do file_tmp=$(ls -t1 $path| grep -i $file | head -n 1) echo $file_tmp if then cp $path$file_tmp $DIR/ap if then...

LEARN ABOUT FREEBSD

dh_installdeb

DH_INSTALLDEB(1)						     Debhelper							  DH_INSTALLDEB(1)

NAME

       dh_installdeb - install files into the DEBIAN directory

SYNOPSIS

       dh_installdeb [debhelperoptions]

DESCRIPTION

       dh_installdeb is a debhelper program that is responsible for installing files into the DEBIAN directories in package build directories with
       the correct permissions.

FILES

       package.postinst
       package.preinst
       package.postrm
       package.prerm
	   These maintainer scripts are installed into the DEBIAN directory.

	   Inside the scripts, the token #DEBHELPER# is replaced with shell script snippets generated by other debhelper commands.

       package.triggers
       package.shlibs
	   These control files are installed into the DEBIAN directory.

	   Note that package.shlibs is only installed in compat level 9 and earlier.  In compat 10, please use dh_makeshlibs(1).

       package.conffiles
	   This control file will be installed into the DEBIAN directory.

	   In v3 compatibility mode and higher, all files in the etc/ directory in a package will automatically be flagged as conffiles by this
	   program, so there is no need to list them manually here.

       package.maintscript
	   Lines in this file correspond to dpkg-maintscript-helper(1) commands and parameters.  However, the "maint-script-parameters" should not
	   be included as debhelper will add those automatically.

	   Example:

	       # Correct
	       rm_conffile /etc/obsolete.conf 0.2~ foo
	       # INCORRECT
	       rm_conffile /etc/obsolete.conf 0.2~ foo -- "$@"

	   In compat 10 or later, any shell metacharacters will be escaped, so arbitrary shell code cannot be inserted here.  For example, a line
	   such as "mv_conffile /etc/oldconffile /etc/newconffile" will insert maintainer script snippets into all maintainer scripts sufficient
	   to move that conffile.

	   It was also the intention to escape shell metacharacters in previous compat levels.	However, it did not work properly and as such it
	   was possible to embed arbitrary shell code in earlier compat levels.

	   The dh_installdeb tool will do some basic validation of some of the commands listed in this file to catch common mistakes.  The
	   validation is enabled as a warning since compat 10 and as a hard error in compat 12.

SEE ALSO

       debhelper(7)

       This program is a part of debhelper.

AUTHOR

       Joey Hess <joeyh@debian.org>

11.1.6ubuntu2							    2018-05-10							  DH_INSTALLDEB(1)

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

recursive copy of hidden files

Discussion started by: usfrog

2. UNIX for Dummies Questions & Answers

copy multiple files in different directories

Discussion started by: ken2834

3. Cybersecurity

Recursive search for group or other writeable 'dot' files

Discussion started by: maficdan

4. Shell Programming and Scripting

Recursive call to find files and directories in Shell script from current path.

Discussion started by: Ramit_Gupta