10-10-2012
Is it better/possible to pause the rsyncing of a very large directory?
Possibly a dumb question, but I'm deciding how I'm going to do this. I'm currently rsyncing a 25TB directory (with several layers of sub directories most of which have video files ranging from 500 megs to 4-5 gigs), from one NAS to another using rsync -av. By the time I need to act ~15TB should have been moved. I need to stop the transfer for ~12 hours. Can I just ^z the process and come back and fg it (this is running in a screen session) or should I just ^c it, and kick it back off and let rsync figure out what's already been transferred on it's own?
9 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I guess I posted in wrong forum before. How do I pause another process and then restart it on linux? The other process doesn't listen for anything.
Thanks for any help you can offer.
Dane :confused: (1 Reply)
Discussion started by: daneensign
1 Replies
2. UNIX for Dummies Questions & Answers
well is gets stuck and i dont know why.......
pid=fork();
if(pid==0)
{
pause();
write(1,"child",5);
exit(0);
}
else
{
sleep(1);
kill(pid,SIGCONT);
write(1,"parent",5);
wait(0);
}
all=1; (1 Reply)
Discussion started by: IdleProc
1 Replies
3. Shell Programming and Scripting
All,
I have one script which gives me the O/P of "percentage of filesystems utilization". we have four filesystem for which i want to check and get the mail when utilization is more than 40%. below are the filesystems.
/AB/Filesy1
/AB/Filesy2
/AB/Filesy3
/AB/Filesy4
Below script is working... (14 Replies)
Discussion started by: anshu ranjan
14 Replies
4. Shell Programming and Scripting
Hi All,
I have searched this forum for related posts but could not find one that fits mine. I have a shell script which removes all the XML tags including the text inside the tags from some 4 million XML files.
The shell script looks like this (MODIFIED):
find . "*.xml" -print | while read... (6 Replies)
Discussion started by: shoaibjameel123
6 Replies
5. Red Hat
Hi,
I've some directory that I used as working directory for a program. At the end of the procedure, the content is deleted. This directory, when I do a ls -l, appears to still take up some space. After a little research, I've seen on a another board of this forum that it's not really taking... (5 Replies)
Discussion started by: bdx
5 Replies
6. Red Hat
Hi. My "/usr" folder is running out of space. My "/home" folder is quite large and has a lot of free space. As follows:
Filesystem Type Size Used Avail Use% Mounted on
...
/dev/sda5 ext3 9.7G 2.6G 6.7G 28% /
/dev/sda7 ext3 152G 16G 128G 11% /home
/dev/sda3 ... (7 Replies)
Discussion started by: pkiula
7 Replies
7. Shell Programming and Scripting
Hi all,
I need a script to delete a large set of files from a directory under / based on an input file and want to redirect errors into separate file.
I have already prepared a list of files in the input file.
Kndly help me.
Thanks,
Prash (36 Replies)
Discussion started by: prash358
36 Replies
8. Shell Programming and Scripting
I have constant trouble with XCOPY/s for multi-gigabyte transfers.
I need a utility like XCOPY/S that remembers where it left off if I reboot. Is there such a utility? How about a free utility (free as in free beer)?
How about an md5sum sanity check too?
I posted the above query in another... (3 Replies)
Discussion started by: siegfried
3 Replies
9. Shell Programming and Scripting
Hi.
I found many scripts in the web of achieving this.
But I like to use this one
find /EDWH-DMT03 -xdev -size +10000 -exec ls -la {} \;|sort -n -k 5 > LARGE.rst
But the problem is, why it still list out files with 89 bytes as the output? Is there anything wrong with the command?
My... (7 Replies)
Discussion started by: aimy
7 Replies
LEARN ABOUT DEBIAN
lsyncd
LSYNCD(1) Lsyncd LSYNCD(1)
NAME
lsyncd - a daemon to continuously synchronize directory trees
SYNOPSIS
config file
*lsyncd* [OPTIONS] CONFIG-FILE
default rsync behaviour
*lsyncd* [OPTIONS] -rsync SOURCEDIR TARGET ...
default rync+ssh bevahiour (moves and deletes through ssh)
*lsyncd* [OPTIONS] -rsyncssh SOURCEDIR TARGETHOST TARGETDIR ...
default direct bevahiour (local file operations/rsync)
*lsyncd* [OPTIONS] -direct SOURCEDIR TARGETDIR ...
DESCRIPTION
Lsyncd(1) watches local directory trees through an event monitor interface (inotify, fsevents). It aggregates and combines events for a few
seconds and then spawns one or more processes to synchronize the changes. By default this is rsync(1). Lsyncd is thus a light-weight
asynchronous live mirror solution that is comparatively easy to install not requiring new filesystems or blockdevices and does not hamper
local filesystem performance.
Rsync+ssh is an advanced action configuration that uses a SSH(1) to act file and directory moves directly on the target instead of
retransmitting the move destination over the wire.
Fine-grained customization can be achieved through the CONFIG-FILE. Custom action configs can even be written from scratch in cascading
layers ranging from shell scripts to code written in the LUA(1) language. This way simplicity can be balanced with powerfulness. See the
online manual for details on the CONFIG-FILE http://code.google.com/p/lsyncd/wiki/Lsyncd20Manual
Note that under normal configuration Lsyncd will delete pre-existing files in the target directories that are not present in the respective
source directory.
OPTIONS
-delay SECS
Overrides the default delay times.
-help
Show a help message.
-insist
Continues startup even if a startup rsync cannot connect.
-log LEVEL
Controls which kind of events are logged. By default Lsyncd logs Normal and Error Messages. -log scarce will make Lsyncd log Error
messages only. -log all will log all debug messages.
-log Category
Turns on a specific debug message. E.g. -log Exec will log all processes as they are spawned.
-nodaemon
Lsyncd will not detach from the invoker and log as well to stdout/err.
-pidfile FILE
Lsyncd will write its process ID in FILE.
-runner FILE
Makes the Lsyncd core load the part of Lsyncd written in Lua from FILE.
-version
Writes version information and exits.
EXIT STATUS
0
Terminated on a TERM signal(7)
-1
Failure (syntax, unrecoverable error condition, internal failure)
SEE ALSO
Online Manual: http://code.google.com/p/lsyncd/wiki/Lsyncd2
VERSION
This man page is for lsyncd(1) version 2.0.5
AUTHOR
Axel Kittenberger, <axkibe@gmail.com> 2010-2011
COPYING
Copyright (C) 2010-2011 Axel Kittenberger. Free use of this software is granted under the terms of the GNU General Public License (GPL)
version 2, or any later version. Free redistrubition of this Documentation (/doc directory) is granted under the terms of the Creative
Commons 3.0 Attribution License (CC-3.0-BY).
Lsyncd 2.0.6 August 2011 LSYNCD(1)