Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help with command to Move files by X number to seperate directories
Top Forums Shell Programming and Scripting Help with command to Move files by X number to seperate directories Post 302407380 by bakunin on Thursday 25th of March 2010 09:02:28 AM
Old 03-25-2010
The most important thing to take into account is to avoid using a for-loop: you would run into an "argument list too long"-error. I have no directory with that many files at hand to test it, but the following should work (i still can't tell you about execution time, test it carefully):

Code:
#! /bin/ksh
typeset iCnt=0
typeset fSrcDir="/path/to/source-dir"
typeset fTgtDir="/path/to/target-dir"
typeset iPart=1
typeset fFile=""

ls "$fSrcDir" | while read fFile ; do
     mv "$fSrcDir/$fFile" "${fTgtDir}/Part${iPart}"
     if [ $? -gt 0 ] ; then
          exit $?
     fi
     (( iCnt += 1 ))
     if [ $iCnt -ge 10000 ] ; then
          iCnt=0
          (( iPart += 1 ))
     fi
done

exit 0

I hope this helps.

bakunin
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Script to move certain number of files every 10 minutes.

Hi, I need to move a certain number of files every 10 minutes from one folder to another. I have written the script below, however its not working, please advise. #! /bin/ksh start() { mv /test1/$(head -1000 /movetst) /test2/ sleep 600 } stop() { exit } ls ti* >... (1 Reply)
Discussion started by: amitsayshii
1 Replies

2. Shell Programming and Scripting

grep'ing for specific directories, and using the output to move files

Hello, this is probably another really simple tasks for most of you gurus, however I am trying to make a script which takes an input, greps a specific file for that input, prints back to screen the results (which are directory names) and then be able to use the directory names to move files.... (1 Reply)
Discussion started by: JayC89
1 Replies

3. UNIX for Dummies Questions & Answers

want to move files in a dir into different directories based on the filename

I want to move the files in a dir to different dirs based on their file names. Ex: i have 4 different files with name - CTS_NONE_10476031_MRL_PFT20081215a.txt CTS_NONE_10633009_MRL_PFT20091020a.txt CTS_NONE_10345673_MRL_PFT20081215a.txt CTS_NONE_10872456_MRL_PFT20091020a.txt and the 1st... (2 Replies)
Discussion started by: Sriranga
2 Replies

4. Shell Programming and Scripting

want to move files in a dir into different directories based on the filename

I want to move the files in a dir to different dirs based on their file names. Ex: i have 4 different files with name - CTS_NONE_10476031_MRL_PFT20081215a.txt CTS_NONE_10633009_MRL_PFT20091020a.txt CTS_NONE_10345673_MRL_PFT20081215a.txt CTS_NONE_10872456_MRL_PFT20091020a.txt and the 1st... (4 Replies)
Discussion started by: Sriranga
4 Replies

5. Shell Programming and Scripting

Loop to move files in different directories

Hi, I have various log files in different paths. e.g. a/b/c/d/e/server.log a/b/c/d/f/server.log a/b/c/d/g/server.log a/b/c/h/e/server.log a/b/c/h/f/server.log a/b/c/h/g/server.log a/b/c/i/e/server.log a/b/c/i/e/server.log a/b/c/i/e/server.log and above these have an archive folder... (6 Replies)
Discussion started by: acc01
6 Replies

6. OS X (Apple)

Batch file to move video files and retain sub-directories

I have just purchased my first ever Apple computer - and am therefore new to UNIX also. I would like to create a simple "batch file" (apologies if this is the wrong terminology) to do the following: When I plug my camera into the MAC it automatically downloads photos and videos into a new... (1 Reply)
Discussion started by: mm0mss
1 Replies

7. Shell Programming and Scripting

Recursively move directories along with files/specific files

I would like to transfer all files ending with .log from /tmp and to /tmp/archive (using find ) The directory structure looks like :- /tmp a.log b.log c.log /abcd d.log e.log When I tried the following command , it movies all the log files... (8 Replies)
Discussion started by: frintocf
8 Replies

8. UNIX for Dummies Questions & Answers

Move multipe files to corresponding directories

Hi, In a parent directory there are several files in the form IDENTIFIER1x IDENTIFIER1.yyy IDENTIFIER1_Z, etc IDENTIFIER2x IDENTIFIER2.yyy IDENTIFIER2_Z, etc IDENTIFIER3x IDENTIFIER3.yyy, IDENTIFIER3_Z, etcIn the same parent directory there are corresponding directories named... (7 Replies)
Discussion started by: spirospap
7 Replies

9. Shell Programming and Scripting

Need BASH Script Help to Move Files While Creating Directories

I've got this script to loop through all folders and move files that are more than 2 years old. I'm using the install command because it creates the necessary directories on the destination path and then I remove the source. I'd like to change the script to use the mv command since it is much... (4 Replies)
Discussion started by: consultant
4 Replies

10. UNIX for Beginners Questions & Answers

Move several files into specific directories with a loop

Hello, I'm a first time poster looking for help in scripting a task in my daily routine. I am new in unix but i am attracted to its use as a mac user. Bear with me... I have several files (20) that I manually drag via the mouse into several named directories over a network. I've used rsync... (14 Replies)
Discussion started by: SonnyClark
14 Replies

LEARN ABOUT MINIX

dh_installdeb

DH_INSTALLDEB(1)						     Debhelper							  DH_INSTALLDEB(1)

NAME

       dh_installdeb - install files into the DEBIAN directory

SYNOPSIS

       dh_installdeb [debhelperoptions]

DESCRIPTION

       dh_installdeb is a debhelper program that is responsible for installing files into the DEBIAN directories in package build directories with
       the correct permissions.

FILES

       package.postinst
       package.preinst
       package.postrm
       package.prerm
	   These maintainer scripts are installed into the DEBIAN directory.

	   Inside the scripts, the token #DEBHELPER# is replaced with shell script snippets generated by other debhelper commands.

       package.triggers
       package.shlibs
	   These control files are installed into the DEBIAN directory.

	   Note that package.shlibs is only installed in compat level 9 and earlier.  In compat 10, please use dh_makeshlibs(1).

       package.conffiles
	   This control file will be installed into the DEBIAN directory.

	   In v3 compatibility mode and higher, all files in the etc/ directory in a package will automatically be flagged as conffiles by this
	   program, so there is no need to list them manually here.

       package.maintscript
	   Lines in this file correspond to dpkg-maintscript-helper(1) commands and parameters.  However, the "maint-script-parameters" should not
	   be included as debhelper will add those automatically.

	   Example:

	       # Correct
	       rm_conffile /etc/obsolete.conf 0.2~ foo
	       # INCORRECT
	       rm_conffile /etc/obsolete.conf 0.2~ foo -- "$@"

	   In compat 10 or later, any shell metacharacters will be escaped, so arbitrary shell code cannot be inserted here.  For example, a line
	   such as "mv_conffile /etc/oldconffile /etc/newconffile" will insert maintainer script snippets into all maintainer scripts sufficient
	   to move that conffile.

	   It was also the intention to escape shell metacharacters in previous compat levels.	However, it did not work properly and as such it
	   was possible to embed arbitrary shell code in earlier compat levels.

	   The dh_installdeb tool will do some basic validation of some of the commands listed in this file to catch common mistakes.  The
	   validation is enabled as a warning since compat 10 and as a hard error in compat 12.

SEE ALSO

       debhelper(7)

       This program is a part of debhelper.

AUTHOR

       Joey Hess <joeyh@debian.org>

11.1.6ubuntu2							    2018-05-10							  DH_INSTALLDEB(1)
All times are GMT -4. The time now is 08:08 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy