Sponsored Content
Full Discussion: Rsync Issues
Special Forums UNIX and Linux Applications Rsync Issues Post 302896532 by treds on Tuesday 8th of April 2014 03:59:14 AM
Old 04-08-2014
Rsync Issues

Hi I am running several syncs from different servers to our data centre.
I am getting some issues with the rsyncs that i am running.
The OS are all red hat enterprise

The rsync command is as follows


Code:
#!/bin/bash
if [ -e /raid/.synclock ]
then
rsync -aWv  --stats progress --delete --ignore-errors --exclude .HS* 
--exclude ._* --exclude .DS_Store --exclude .Trashes --exclude .TemporaryItems 
--exclude .VolumeIcon.icns --exclude .apdisk --no-links /raid/  172.30.8.12:/gpfs/STUDIO_
RSYNCS/PEARTREE/ >> /raid/Rsync_logs/Peartree_rsync.`date +%w`.log 2>&1

else
	echo "lock file not present. Exiting"  >> /raid/Rsync_logs/Peartree_rsync.`date +%w`.log 2>&1
fi


The issues i am getting is firstly a time out.

Connection to 172.30.8.12 closed by remote host.
rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Broken pipe (32)
rsync: connection unexpectedly closed (210 bytes received so far) [sender]
rsync error: unexplained error (code 255) at io.c(600) [sender=3.0.6]




and secondly a delete error


annot delete non-empty directory: PRODUCTION/PEARTREE/ARCADIA_GROUP_LTD/70003138_DP_CLOTHING_AND_ACCESSORY_SHOTS

Thirdly the excludes do not seem to be working correctly.

example
PRODUCTION/CHILLIWORLDWIDE/PORTFOLIOS/PHOTOGRAPHERS FOLIOS/DAN H/NEW PORTFOLIO/HI RES/DAVIDOFF/._ASHTRAY 1_07.tif

this should be excluded with the exclude ._*

thanks in advance
Treds
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

rsync vs cp

Hi guys, I will be copying data from one FS to another. (only once) These are local Filesystems... Which tool would be more efficient to use in this case? There is a huge amount of data that needs to be copied... (1.5TB) John (1 Reply)
Discussion started by: jsy
1 Replies

2. UNIX for Dummies Questions & Answers

rsync

i last night i copied a 400GB folder using rsync and ssh i did: rsync -r /mnt/500_GB ssh miguel@192.168.1.3:/mnt/1500_GB and it copied the folder fine all 400GB. The question is: If i put more files to that initial 400GB folder, which command can i run on my server for it to update the... (4 Replies)
Discussion started by: supermiguel
4 Replies

3. Shell Programming and Scripting

rsync

hi there I wonder if some-one can help. I am trying to use rsync on my mac to transfer a folder to a remote machine. I have logged into rysnc on my mac no problem and I'm trying to execute this command: rsync -a -e ssh /Users/myname/myfolder/sourcefolder/... (3 Replies)
Discussion started by: volterony
3 Replies

4. Shell Programming and Scripting

rsync

Am I correct in assuming that the following command: rsync -a /a /b does not make any changes on /a if there are files on /b that are newer (2 Replies)
Discussion started by: jgt
2 Replies

5. UNIX for Dummies Questions & Answers

Rsync Help?

Hi everyone, I'm pretty new to rsync and I've been tasked to "fix" an existing .sh to make it work the way I need it to. I have the following rsync set up on a cron job: /usr/local/bin/rsync --stats -qPzrtpl --delete --password-file=/var/run/.appprodrsync ... (2 Replies)
Discussion started by: Russell P
2 Replies

6. Shell Programming and Scripting

Rsync through java program - issues with remote connection failure

Hi Everybody, I am running rsync through my java application. The Java application will sync the files with remote machine. During our connection failure testing we noticed an issue running rsync through java program. The java application which is running at source side is not receiving any... (2 Replies)
Discussion started by: MVEERA
2 Replies

7. UNIX for Dummies Questions & Answers

rsync

Hi all, I'm new to the rsync world in hpux. Currently I have rsync going through the main public lan, but dude to traffic loads, I have been told that i need to use a dedicated rsync lan. I currently have 4 spare nics and the plan was to use one of these for the rsync, but I can't figure out... (2 Replies)
Discussion started by: linuxwanabe
2 Replies

8. Shell Programming and Scripting

Need help on rsync

Hi experts, We need copy 5TB data from one server to another (over a 10Gbps link). We plan to use rsync -av remote:/<path /local on destination server but there're few special requirements like: 1. data copy process should run only from 18:00 Hrs to 07:00 every day until copy is completed. Is... (1 Reply)
Discussion started by: magnus29
1 Replies

9. Shell Programming and Scripting

Facing issues with rsync

Hello Gurus, I am running rsync command to copy certain Directories and files into that directories to remote server. While ruuning the command all teh files has been copied but I am facing error. The below command I am executing to copy Directories and files to remote server: rsync -avrz ssh... (3 Replies)
Discussion started by: pokhraj_d
3 Replies

10. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies
RoPkg::Rsync::ConfFile(3pm)				User Contributed Perl Documentation			       RoPkg::Rsync::ConfFile(3pm)

NAME
RoPkg::Rsync::ConfFile DESCRIPTION
RoPkg::Rsync::ConfFile is a class used to manipulate rsync configuration files. Is capable to maintaine the order of the modules, and even keep your comments and empty lines intact. SYNOPSIS
#!/usr/bin/perl use warnings; use strict; sub main { my $cf = new RoPkg::Rsync::ConfFile(filename => '/etc/rsyncd.conf'); $cf->Write('/tmp/new_rsyncd.conf'); return 0; } main(); METHODS
All methods, throw the OutsideClass exception, if you use them as class methods. Besides OutsideClass the methods are throwing other exceptions as well. Refer to each method documentation for more information. new(%hash) The class constructor. Accepts a hash as parameter. At this moment only one parameter can be specified inside the hash: filename . If this parameter is present, the file specified is parsed and loaded into the object. AddParam($pname, $pvalue) Add a new global parameter named $pname with value $value. AddComment($pval) Add a new global comment with value $pval AddBlank($bval) Add a new global blank line with value $bval AddNode($node) Adds a new RoPkg::Rsync::Node object to the current object. Before the node is added, the nodes list is checked for duplicates of the object. If a duplicate is found, the method does nothing. Exceptions: If $node is not a instance of RoPkg::Rsync::Node, Param::Wrong exception is raised. DelNode($node_name) Removes a node from the nodes list. The nodes are searched by their names. Returns -1 if the node was not found, the new number of nodes otherwise. HasNode($node_name) Returns 1 if the node with name $node_name was found in the nodes list, 0 otherwise. Clean() Clean the object. Removes all information (the nodes list, statistics, etc). Always returns 1. Parse($filename) Parse the configuration file $filename and returns the number of nodes. If $filename is not defined Param::Missing exception is raised. If the path does not point to a existing file, File::NotFound exception is raised. If the file could not be opened, File::Open exception is raised. Write($path) Write the configuration into the file specified by path $path. ToString() Returns the string representation of the configuration file. PREREQUISITES
perl 5.008 (or later) is required. Besides perl, you must have the following: *) RoPkg::Exceptions *) Scalar::Util *) English SEE ALSO
RoPkg::Rsync::Atom RoPkg::Rsync::ConfFile RoPkg::Exceptions AUTHOR
Subredu Manuel <diablo@iasi.roedu.net> LICENSE
Copyright (C) 2005 Subredu Manuel. All Rights Reserved. This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The LICENSE file contains the full text of the license. perl v5.8.8 2006-06-09 RoPkg::Rsync::ConfFile(3pm)
All times are GMT -4. The time now is 03:33 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy