Script to move certain no. of files every second Post: 303001443

Sponsored Content

Top Forums Shell Programming and Scripting Script to move certain no. of files every second Post 303001443 by Raj1184 on Thursday 3rd of August 2017 03:33:00 PM

08-03-2017

Registered User

Script to move certain no. of files every second

Hi All,

I am new to Linux/Scripting and need some assistance in coming up with a script that can move certain amount of files from one directory to other every seconds.

Usercase: We have around 100k files in tmp directory on my server which needs to be moved to another folder to get processed. However I can not move all files at once due to limitations with file parsing as it hangs after seeing 100k files at once and can move around 10 files per seconds.

It would be helpful if someone can suggest a best way to achieve this through a shell script.

Thanks in advance.

Regards,
Raj

Raj1184

View Public Profile for Raj1184

Find all posts by Raj1184

7 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Script to move trace files

Please debug this shell script for me.. Basically the idea is to run the script, based on the command to move some trace files to a separate directory and I am getting the error. Only the COMMAND that has rm {} works and I basically want to use it for the fourth one. Please try for the 2nd, 3rd and...

2. UNIX for Dummies Questions & Answers

Script to move blank files

Anyone could give me an example of scrip to move blank files found into a dir? Thanks, Leandro Takeda

3. Shell Programming and Scripting

Perl script to move files not in use

I need to write a script to move files only when they are not in use. I have a rudementry bash script for Linux but i need a perl script so it will work on Linux and hpux. Oracle writes files to a directory called /data and the files there are moved every 5 minutes to a new home. But i need to...

4. Shell Programming and Scripting

Need script to move files based on name

Hi folks, I'm new here and appreciate greatly any help. I have a bunch of files that need be moved and renamed. Fortunately, they are all in sequence... Present filename and path: /.catalog1/t76038_842-01 Move to: /.catalog1/76038-01 So, we need to drop the...

5. Shell Programming and Scripting

Need shell script to move files

Hi , I need a simple shell script to move the files from one directory to another directory after every 1 hour..!!! ??

6. Shell Programming and Scripting

help with a script to gzip/move files

Hi Please can you help me in writing a script to find files on a specific directory, and of extension "tap" but only of the month of september, gzip and move them to another directory. Your help will be appreciated.

7. Shell Programming and Scripting

Script move files by name

hi, I have a lot of files named xxxxx__AA.txt, xxxxx__BB.txt, xxxxx__CC.txt and I would like to move xxxxx__AA.txt in AA directory, xxxxx__BB.txt in BB etc. Could you help me do it in bash script?

LEARN ABOUT CENTOS

git-mv

GIT-MV(1)							    Git Manual								 GIT-MV(1)

NAME

       git-mv - Move or rename a file, a directory, or a symlink

SYNOPSIS

       git mv <options>... <args>...

DESCRIPTION

       This script is used to move or rename a file, directory or symlink.

	   git mv [-v] [-f] [-n] [-k] <source> <destination>
	   git mv [-v] [-f] [-n] [-k] <source> ... <destination directory>

       In the first form, it renames <source>, which must exist and be either a file, symlink or directory, to <destination>. In the second form,
       the last argument has to be an existing directory; the given sources will be moved into this directory.

       The index is updated after successful completion, but the change must still be committed.

OPTIONS

       -f, --force
	   Force renaming or moving of a file even if the target exists

       -k
	   Skip move or rename actions which would lead to an error condition. An error happens when a source is neither existing nor controlled
	   by Git, or when it would overwrite an existing file unless -f is given.

       -n, --dry-run
	   Do nothing; only show what would happen

       -v, --verbose
	   Report the names of files as they are moved.

GIT

       Part of the git(1) suite

Git 1.8.3.1							    06/10/2014								 GIT-MV(1)