Sponsored Content
Full Discussion: Need help on rsync
Top Forums Shell Programming and Scripting Need help on rsync Post 302961149 by magnus29 on Tuesday 24th of November 2015 12:12:14 PM
Old 11-24-2015
Need help on rsync

Hi experts,

We need copy 5TB data from one server to another (over a 10Gbps link). We plan to use rsync -av remote:/<path /local on destination server but there're few special requirements like:

1. data copy process should run only from 18:00 Hrs to 07:00 every day until copy is completed. Is it a good idea to cron 2 jobs - one of them starts script at 18:00 and the other kills it at 7:00?
2. log should be emailed once in every 60 minutes. I noticed there're lot of redundant unnecessary info in the logs. is there any filter?
3. can transfer speed be controlled? (to reduce a bit so that it won't choke entire bandwidth)
4. rsync version on destination machine is 3.0.6. yum update rsync says this is final version.
5. I think there's no need for rsync daemon just standalone command would suffice. please confirm.

Please advise, Many thanks!!
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

rsync

I want to do rsync only for the difference in the last 30 days. How do I specify the "30 days" on the command line below? >rsync -avz prj# /rsource /destination Thanks for help (6 Replies)
Discussion started by: wz253
6 Replies

2. UNIX for Dummies Questions & Answers

rsync vs cp

Hi guys, I will be copying data from one FS to another. (only once) These are local Filesystems... Which tool would be more efficient to use in this case? There is a huge amount of data that needs to be copied... (1.5TB) John (1 Reply)
Discussion started by: jsy
1 Replies

3. Solaris

please help in rsync

Dear all, I m trying to rsync a file remotely but it is throwing following error. #/opt/sfw/bin/rsync -v -a -e ssh user@xx.xx.xx.xx:/export/home/naresh/utils.sh bash: rsync: command not found rsync: connection unexpectedly closed (0 bytes read so far) rsync error: error in... (10 Replies)
Discussion started by: naree
10 Replies

4. UNIX for Dummies Questions & Answers

rsync

i last night i copied a 400GB folder using rsync and ssh i did: rsync -r /mnt/500_GB ssh miguel@192.168.1.3:/mnt/1500_GB and it copied the folder fine all 400GB. The question is: If i put more files to that initial 400GB folder, which command can i run on my server for it to update the... (4 Replies)
Discussion started by: supermiguel
4 Replies

5. Shell Programming and Scripting

rsync

hi there I wonder if some-one can help. I am trying to use rsync on my mac to transfer a folder to a remote machine. I have logged into rysnc on my mac no problem and I'm trying to execute this command: rsync -a -e ssh /Users/myname/myfolder/sourcefolder/... (3 Replies)
Discussion started by: volterony
3 Replies

6. Shell Programming and Scripting

rsync

Am I correct in assuming that the following command: rsync -a /a /b does not make any changes on /a if there are files on /b that are newer (2 Replies)
Discussion started by: jgt
2 Replies

7. SuSE

rsync

I'm trying to use rsync to sync some data from my windows laptop to my linux openSUSE home sytem using cwRsync. The process has always worked until I got a new laptop and more or less at the same time decided to rebuild my linux box. on linux rsync --version rsync version 3.0.7 protocol... (2 Replies)
Discussion started by: giessenw
2 Replies

8. UNIX for Dummies Questions & Answers

rsync

Hi all, I'm new to the rsync world in hpux. Currently I have rsync going through the main public lan, but dude to traffic loads, I have been told that i need to use a dedicated rsync lan. I currently have 4 spare nics and the plan was to use one of these for the rsync, but I can't figure out... (2 Replies)
Discussion started by: linuxwanabe
2 Replies

9. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies
librsync(3)						     Library Functions Manual						       librsync(3)

NAME
librsync - library for delta compression of streams SYNOPSYS
#include <stdio.h> #include <stdlib.h> #include <librsync.h> cc ... -lrsync DESCRIPTION
The librsync library implements network delta-compression of streams and files. The algorithm is similar to that used in the rsync(1) and xdelta(2) programs, but specialized for transfer of arbitrary-length octet streams. Unlike most diff programs, librsync does not require access to both of the files on the same machine, but rather only a short ``signature'' of the old file and the complete contents of the new file. The canonical use of librsync is in the rproxy(8) reference implementation of the rsync proposed extension to HTTP. It may be useful to other programs which wish to do delta-compression in HTTP, or within their own protocol. There are HTTP-specific utility functions within librsync, but they need not be used. A number of tools such as rdiff(1) provide command-line and scriptable access to rsync functions. SEE ALSO
rdiff(1) rdiff and librsync Manual http://rproxy.sourceforge.net/. draft-pool-rsync BUGS
The rsync protocol is still evolving. There may be bugs in the implementation. The interface may change in the future, but it is becoming more stable. Many routines will panic in case of error rather than returning an error code to the caller. Patches to fix this are welcome, but at the current state of development aborting seems as useful as trusting to possibly-incomplete checking in the client. AUTHOR
Martin Pool <mbp@samba.org>, with Andrew Tridgell <tridge@samba.org>. rdiff development has been supported by Linuxcare, Inc and VA Linux Systems. Martin Pool $Date: 2003/06/12 06:03:32 $ librsync(3)
All times are GMT -4. The time now is 04:40 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy