rsync: writefd_unbuffered failed


 
Thread Tools Search this Thread
Homework and Emergencies Emergency UNIX and Linux Support rsync: writefd_unbuffered failed
# 1  
Old 01-19-2011
rsync: writefd_unbuffered failed

hi guys.

I have configured rsync to make a mirror, but there is an error, I don't understand in the logfile:

Code:
2011/01/18 16:54:25 [3634] rsync on centos/ from UNKNOWN (212.120.196.127)
2011/01/18 15:56:00 [3634] rsync: writefd_unbuffered failed to write 4 bytes [sender]: Connection reset by peer (104)
2011/01/18 15:56:00 [3634] rsync error: error in rsync protocol data stream (code 12) at io.c(1119) [sender=2.6.8]

any idea?
# 2  
Old 01-19-2011
You need to check logs on the far end, to see why your correspondent process took a powder. "Connection reset by peer" can be a remote end socket fd close(), or the implicit close() of an exit(). Look for core files, too, there.
# 3  
Old 01-19-2011
At a higher level, if the rsync is using ssh as a tunneling protocol, then it could be the ssh session timed out or reset. Check with the sshd_config on the other side to see if such a thing is configured. Or if rsync uses its own protocol (rsync daemon), it could be that process ran out of memory. rsync is susceptible to oom errors.
# 4  
Old 01-20-2011
I guess the ssh guys forgot to make an ssync like scp for rcp and ssh for rsh. I have found ssh tunnels a bit troublesome in some cases, yet solid in others. Running out of memory may be shortage of swap for VM, as almost nobody uses RAM directly any more.

I make my mirrors with: find * -newer mark_file -type f|cpio make archive|some compressor|ssh or rsh "matching uncompressor|cpio unpack update only make dirs". It spreads the load out and gives me choice of compressors to match network/CPU speed. I can even split the load up with "find ...|xdemux n '...' ", my dumb mux tool, into N parallel streams. I can add nice to the compressors if there are residents that might need CPU on the sending end. Just create a new mark file and sleep 1 second before starting each run, and when done, make the new mark the next old mark file.
# 5  
Old 01-21-2011
rsync is a good way to make a mirror, as it uses a minimum change-set to copy make sure the two sides have the same contents.

As for the timeout... post more information if you still have the problem: What protocol is rsync using to connect to the remote side? (rsync's own or ssh) Does the problem happen all the time, or just some of the time? Is the "handle files with holes" option in use? If not, make sure you dont copy db/dbm files and the like. Does the problem occur if you do a *local* rsync - using the same host via the loopback connection?
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Issue with rsync: failed to set times on "/tmp/.": Not owner (1)

Hi, Here is my source host and folder details. $ hostname source-host $ id uid=600000208(src-user) gid=64688(src-user) groups=64688(src-user) $ ls -ltrd /web/Trn_File/data/ drwxrwxrwx 3 src-user src-user 4096 Feb 7 15:27 /web/Trn_File/data/ $ ls -ltrd /web/Trn_File/data/* drwxrwxrwx 8... (1 Reply)
Discussion started by: mohtashims
1 Replies

2. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies

3. Shell Programming and Scripting

Need help on rsync

Hi experts, We need copy 5TB data from one server to another (over a 10Gbps link). We plan to use rsync -av remote:/<path /local on destination server but there're few special requirements like: 1. data copy process should run only from 18:00 Hrs to 07:00 every day until copy is completed. Is... (1 Reply)
Discussion started by: magnus29
1 Replies

4. Fedora

Rsync failed

I was backing up a home directory and had rsync fail on me. I noticed that it was trying to copy a large file (over 4.2 gigs). That made me wonder if the code is 32 bit and failed on the 2 ^32 (max size issue) The code which I invoked is as follows: rsync -aPH... (0 Replies)
Discussion started by: robertdaleweir
0 Replies

5. UNIX for Dummies Questions & Answers

Rsync Help?

Hi everyone, I'm pretty new to rsync and I've been tasked to "fix" an existing .sh to make it work the way I need it to. I have the following rsync set up on a cron job: /usr/local/bin/rsync --stats -qPzrtpl --delete --password-file=/var/run/.appprodrsync ... (2 Replies)
Discussion started by: Russell P
2 Replies

6. SuSE

rsync

I'm trying to use rsync to sync some data from my windows laptop to my linux openSUSE home sytem using cwRsync. The process has always worked until I got a new laptop and more or less at the same time decided to rebuild my linux box. on linux rsync --version rsync version 3.0.7 protocol... (2 Replies)
Discussion started by: giessenw
2 Replies

7. Shell Programming and Scripting

rsync

Am I correct in assuming that the following command: rsync -a /a /b does not make any changes on /a if there are files on /b that are newer (2 Replies)
Discussion started by: jgt
2 Replies

8. Solaris

Cygwin X Server error: xdmcp fatal error session failed session 23 failed for display

Hi, i got the following error when i tried to access the cygwin x server from a windows XP PC. "xdmcp fatal error session failed session 23 failed for display" Alternatively, when i tried to access the same Cygwin X Server from another windows XP PC which is on a different LAN... (3 Replies)
Discussion started by: HarishKumarM
3 Replies

9. AIX

SFTP Failed---Request for subsystem 'sftp' failed on channel 0

Hi, While I am trying SFTP my machine to another unix machine , it was working fine till 10 min back. But now i am getting the below error "Request for subsystem 'sftp' failed on channel 0" Could you please someone help me to solve or analyise the root cause... Cheers:b:, Mahiban (0 Replies)
Discussion started by: mahiban
0 Replies
Login or Register to Ask a Question