Sponsored Content
Top Forums Shell Programming and Scripting Help with command to Move files by X number to seperate directories Post 302407376 by Geo_Bean on Thursday 25th of March 2010 08:37:55 AM
Old 03-25-2010
Help with command to Move files by X number to seperate directories

Hello,

I need help finding a script that will allow me to move files from one directory to another directory 10k files at a time.

I have a directory that has 100 K files in it. I need to have those 100k files broken apart to separate directories each with 10k files in them.

Here is the diagram of what i'm trying to do.

Dir1
100000 files

Needs to be broken apart every 10000 files and those need to be in a new directory

NEWDIRA = 10000 files
NEWDIRB = 10000 files

If anyone knows of a command that would allow this to be run that would help greatly. Thanks

Geo_Bean
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Script to move certain number of files every 10 minutes.

Hi, I need to move a certain number of files every 10 minutes from one folder to another. I have written the script below, however its not working, please advise. #! /bin/ksh start() { mv /test1/$(head -1000 /movetst) /test2/ sleep 600 } stop() { exit } ls ti* >... (1 Reply)
Discussion started by: amitsayshii
1 Replies

2. Shell Programming and Scripting

grep'ing for specific directories, and using the output to move files

Hello, this is probably another really simple tasks for most of you gurus, however I am trying to make a script which takes an input, greps a specific file for that input, prints back to screen the results (which are directory names) and then be able to use the directory names to move files.... (1 Reply)
Discussion started by: JayC89
1 Replies

3. UNIX for Dummies Questions & Answers

want to move files in a dir into different directories based on the filename

I want to move the files in a dir to different dirs based on their file names. Ex: i have 4 different files with name - CTS_NONE_10476031_MRL_PFT20081215a.txt CTS_NONE_10633009_MRL_PFT20091020a.txt CTS_NONE_10345673_MRL_PFT20081215a.txt CTS_NONE_10872456_MRL_PFT20091020a.txt and the 1st... (2 Replies)
Discussion started by: Sriranga
2 Replies

4. Shell Programming and Scripting

want to move files in a dir into different directories based on the filename

I want to move the files in a dir to different dirs based on their file names. Ex: i have 4 different files with name - CTS_NONE_10476031_MRL_PFT20081215a.txt CTS_NONE_10633009_MRL_PFT20091020a.txt CTS_NONE_10345673_MRL_PFT20081215a.txt CTS_NONE_10872456_MRL_PFT20091020a.txt and the 1st... (4 Replies)
Discussion started by: Sriranga
4 Replies

5. Shell Programming and Scripting

Loop to move files in different directories

Hi, I have various log files in different paths. e.g. a/b/c/d/e/server.log a/b/c/d/f/server.log a/b/c/d/g/server.log a/b/c/h/e/server.log a/b/c/h/f/server.log a/b/c/h/g/server.log a/b/c/i/e/server.log a/b/c/i/e/server.log a/b/c/i/e/server.log and above these have an archive folder... (6 Replies)
Discussion started by: acc01
6 Replies

6. OS X (Apple)

Batch file to move video files and retain sub-directories

I have just purchased my first ever Apple computer - and am therefore new to UNIX also. I would like to create a simple "batch file" (apologies if this is the wrong terminology) to do the following: When I plug my camera into the MAC it automatically downloads photos and videos into a new... (1 Reply)
Discussion started by: mm0mss
1 Replies

7. Shell Programming and Scripting

Recursively move directories along with files/specific files

I would like to transfer all files ending with .log from /tmp and to /tmp/archive (using find ) The directory structure looks like :- /tmp a.log b.log c.log /abcd d.log e.log When I tried the following command , it movies all the log files... (8 Replies)
Discussion started by: frintocf
8 Replies

8. UNIX for Dummies Questions & Answers

Move multipe files to corresponding directories

Hi, In a parent directory there are several files in the form IDENTIFIER1x IDENTIFIER1.yyy IDENTIFIER1_Z, etc IDENTIFIER2x IDENTIFIER2.yyy IDENTIFIER2_Z, etc IDENTIFIER3x IDENTIFIER3.yyy, IDENTIFIER3_Z, etcIn the same parent directory there are corresponding directories named... (7 Replies)
Discussion started by: spirospap
7 Replies

9. Shell Programming and Scripting

Need BASH Script Help to Move Files While Creating Directories

I've got this script to loop through all folders and move files that are more than 2 years old. I'm using the install command because it creates the necessary directories on the destination path and then I remove the source. I'd like to change the script to use the mv command since it is much... (4 Replies)
Discussion started by: consultant
4 Replies

10. UNIX for Beginners Questions & Answers

Move several files into specific directories with a loop

Hello, I'm a first time poster looking for help in scripting a task in my daily routine. I am new in unix but i am attracted to its use as a mac user. Bear with me... I have several files (20) that I manually drag via the mouse into several named directories over a network. I've used rsync... (14 Replies)
Discussion started by: SonnyClark
14 Replies
cp(1)							      General Commands Manual							     cp(1)

Name
       cp - copy file data

Syntax
       cp [ -f ] [ -i ] [ -p ] file1 file2

       cp [ -f ] [ -i ] [ -p ] [ -r ] file... directory

       cp [ -f ] [ -i ] [ -p ] [ -r ] directory... directory

Description
       The command copies file1 onto file2.  The mode and owner of file2 are preserved if it already existed; the mode of file1 is used otherwise.
       Note that the command will not copy a file onto itself.

       In the second form, one or more files are copied into the directory with their original file names.

       In the third form, one or more source directories are copied into the destination directory with their original file names.

Options
       -f   Forces existing destination pathnames to be removed before copying, without prompting for confirmation.  The -i option is  ignored	if
	    the -f option is specified.

       -i   Prompts  user  with  the name of file whenever the copy will cause an old file to be overwritten. A yes answer will cause to continue.
	    Any other answer will prevent it from overwriting the file.

       -p   Preserves (duplicates) in the copies the modification time, access time, file mode, user ID, and group ID as allowed  by  the  permis-
	    sions of the source files, ignoring the present umask.

       -r   Copies  directories.  Entire directory trees, including their subtrees and the individual files they contain, are copied to the speci-
	    fied destination directory. The directory, its subtrees, and the individual files retain their original names. For	example,  to  copy
	    the directory including all of its subtrees and files, into the directory enter the following command:
	    cp -r reports news

See Also
       cat(1), pr(1), mv(1)

																	     cp(1)
All times are GMT -4. The time now is 02:25 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy