Synching files using rsync utility


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Synching files using rsync utility
# 1  
Old 11-09-2012
Linux Synching files using rsync utility

Iam using rsync tool to sync files from one linux server to other linux server, however it takes huge time to finish it. so I tried running multiple instances of rsync for different directories in background and it resulted in the below mentioned error.

rsync comand used:

/usr/bin/rsync -acrz ${ABS_DIR} -e /usr/bin/rsh ${TARGET}:${TARGET_DIR} &

the below error was thrown,

poll: protocol failure in circuit setup
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]


Please let me know whether is it possible to run multiple instances from one server to another server and if it is possible, please guide me...

ThanksSmilie

The network connections are fine...

Last edited by Kesavan; 11-09-2012 at 01:50 AM.. Reason: provided some more details
# 2  
Old 11-09-2012
What does the rsyncd.conf file have for max connections?

What does syslog say about errors on the remote side?
# 3  
Old 11-20-2012
There is no rsyncd.conf file, as per my understanding it is needed only when you are running rsync as a daemon (let me know if Iam wrong)

This is what the syslog shows

Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11703 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11703 duration=0(sec)
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11705 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11706 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11707 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11708 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11710 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11713 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11714 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11715 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11716 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11717 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: FAIL: shell per_source_limit from=192.168.10.3
Nov 20 09:34:33 H00HOST last message repeated 10 times
Nov 20 09:34:33 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11707 duration=0(sec)
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11739 from=192.168.10.3
Nov 20 09:34:33 H00HOST xinetd[2404]: FAIL: shell per_source_limit from=192.168.10.3
Nov 20 09:34:33 H00HOST last message repeated 9 times
Nov 20 09:34:33 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11713 duration=0(sec)
Nov 20 09:34:33 H00HOST xinetd[2404]: START: shell pid=11752 from=192.168.10.3
Nov 20 09:34:34 H00HOST xinetd[2404]: FAIL: shell per_source_limit from=192.168.10.3
Nov 20 09:34:34 H00HOST last message repeated 3 times
Nov 20 09:34:34 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11708 duration=1(sec)
Nov 20 09:34:34 H00HOST xinetd[2404]: START: shell pid=11759 from=192.168.10.3
Nov 20 09:34:34 H00HOST xinetd[2404]: FAIL: shell per_source_limit from=192.168.10.3
Nov 20 09:34:34 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11716 duration=1(sec)
Nov 20 09:34:34 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11752 duration=1(sec)
Nov 20 09:34:35 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11714 duration=2(sec)
Nov 20 09:34:35 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11705 duration=2(sec)
Nov 20 09:34:36 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11759 duration=2(sec)
Nov 20 09:34:36 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11715 duration=3(sec)
Nov 20 09:34:36 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11739 duration=3(sec)
Nov 20 09:34:44 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11710 duration=11(sec)
Nov 20 09:34:44 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11717 duration=11(sec)
Nov 20 09:34:44 H00HOST xinetd[2404]: EXIT: shell status=0 pid=11706 duration=11(sec)


This is what the error shown in the screen


poll: protocol failure in circuit setup
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
poll: protocol failure in circuit setup
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
poll: protocol failure in circuit setup
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
poll: protocol failure in circuit setup
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
poll: protocol failure in circuit setup
poll: protocol failure in circuit setup
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Ubuntu

Rsync - not copy certain files

I use this rsync --progress -r -u /media/andy/MAXTOR_SDB1/Ubuntu_Mate_18.04/* /home/andy/Ubuntu_18.04_Programs/Is there a way to have it not copy files such as these? 2019-02-25_11:04 I found this but can not figure out what it's doing. 3. Exclude a specific file To exclude a... (5 Replies)
Discussion started by: drew77
5 Replies

2. Shell Programming and Scripting

Rsync and Move files

I Have a requirement where i have to sync two directories one on source location server A and other on destination location server B as i do not have ssh access from server A----------->B I am doing rsync from server B, The Requirement is as follows Two directories on the source and... (4 Replies)
Discussion started by: James0806
4 Replies

3. Shell Programming and Scripting

Rsync files check

Hello everybody, I sent some files a remote server using simple ssh command line: rsync -e 'ssh -p SSH-PORT' -vr --log-file=/var/log/rsync.log /home/USER/www/* USER@IP:/home/USER/www Then I would like to check if files in server1 are the same, file size check or any other way to make... (4 Replies)
Discussion started by: Abu Rayane
4 Replies

4. UNIX for Dummies Questions & Answers

Ntpdate not synching with w32time on Windows XP

Hi all. I'm new to this forum and Linux in general. Last month I ran into a problem at work and never got around to solving it. We have an old Linux workstation that synchs its time to a Windows XP machine running w32time. The version of ntpdate is 4.2.0.a running on Linux kernel 2.6.17.6. It... (0 Replies)
Discussion started by: rathauneek
0 Replies

5. Shell Programming and Scripting

rsync copy files once

Hi This is my situation I have files on the left which I want to copy to the right. Once the files are copied to the right, they are processed and then deleted. The next time rsync runs I dont want it to copy the same files again, it should only copy any new files to the right. I have been... (4 Replies)
Discussion started by: duonut
4 Replies

6. Shell Programming and Scripting

Rsync temporary files

Hi, I am looking to use rsync in a very specific way, and even though I have trawled the rsync man pages I have not succeeded in seeing a way of doing the following: The temporary files created by rsync should not be created in the destination directory. (I have used --temp-dir option to... (0 Replies)
Discussion started by: LostInTheWoods
0 Replies

7. Shell Programming and Scripting

How to Unzip a file using unzip utility for files zipped without zip utility ?

Hi, I need to zip/compress a data file and send to a vendor. The vendor does have only unzip utility and can accept only .ZIP files. I do not have zip utility in my server. How do I zip/compress the file so that it can be deflated using unzip command ? I tried gzip & compress commands, but... (1 Reply)
Discussion started by: Sabari Nath S
1 Replies

8. Shell Programming and Scripting

Utility or script for renaming files on UNIX web server

Greetings! Does anyone know of a utility or a script for renaming files on a UNIX web server? I've seen several of these types of renaming utilities for Windows, but none for UNIX. I have 10,000 files that I need to rename in a several tier (deep) web site directory. I have the original... (2 Replies)
Discussion started by: everettr
2 Replies

9. UNIX for Dummies Questions & Answers

rsync, which files where moved?

Hello, I am using rsync to make sure that my folder "local" mirrors the remote directory "remote". When a file is copied from "remote" to "local", I need to apply a bash script to it. What would be a neat way to do that? Thanks ps: is there a way to edit the title of the thread (I am a bit... (5 Replies)
Discussion started by: JCR
5 Replies

10. UNIX for Advanced & Expert Users

Utility or script for renaming files on UNIX web server

Greetings! Does anyone know of a utility or a script for renaming files on a UNIX web server? I've seen several of these types of renaming utilities for Windows, but none for UNIX. I have 10,000 files that I need to rename in a several tier (deep) web site directory. I have the original... (1 Reply)
Discussion started by: everettr
1 Replies
Login or Register to Ask a Question