Sponsored Content
Full Discussion: Rsync Issues
Special Forums UNIX and Linux Applications Rsync Issues Post 302896532 by treds on Tuesday 8th of April 2014 03:59:14 AM
Old 04-08-2014
Rsync Issues

Hi I am running several syncs from different servers to our data centre.
I am getting some issues with the rsyncs that i am running.
The OS are all red hat enterprise

The rsync command is as follows


Code:
#!/bin/bash
if [ -e /raid/.synclock ]
then
rsync -aWv  --stats progress --delete --ignore-errors --exclude .HS* 
--exclude ._* --exclude .DS_Store --exclude .Trashes --exclude .TemporaryItems 
--exclude .VolumeIcon.icns --exclude .apdisk --no-links /raid/  172.30.8.12:/gpfs/STUDIO_
RSYNCS/PEARTREE/ >> /raid/Rsync_logs/Peartree_rsync.`date +%w`.log 2>&1

else
	echo "lock file not present. Exiting"  >> /raid/Rsync_logs/Peartree_rsync.`date +%w`.log 2>&1
fi


The issues i am getting is firstly a time out.

Connection to 172.30.8.12 closed by remote host.
rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]: Broken pipe (32)
rsync: connection unexpectedly closed (210 bytes received so far) [sender]
rsync error: unexplained error (code 255) at io.c(600) [sender=3.0.6]




and secondly a delete error


annot delete non-empty directory: PRODUCTION/PEARTREE/ARCADIA_GROUP_LTD/70003138_DP_CLOTHING_AND_ACCESSORY_SHOTS

Thirdly the excludes do not seem to be working correctly.

example
PRODUCTION/CHILLIWORLDWIDE/PORTFOLIOS/PHOTOGRAPHERS FOLIOS/DAN H/NEW PORTFOLIO/HI RES/DAVIDOFF/._ASHTRAY 1_07.tif

this should be excluded with the exclude ._*

thanks in advance
Treds
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

rsync vs cp

Hi guys, I will be copying data from one FS to another. (only once) These are local Filesystems... Which tool would be more efficient to use in this case? There is a huge amount of data that needs to be copied... (1.5TB) John (1 Reply)
Discussion started by: jsy
1 Replies

2. UNIX for Dummies Questions & Answers

rsync

i last night i copied a 400GB folder using rsync and ssh i did: rsync -r /mnt/500_GB ssh miguel@192.168.1.3:/mnt/1500_GB and it copied the folder fine all 400GB. The question is: If i put more files to that initial 400GB folder, which command can i run on my server for it to update the... (4 Replies)
Discussion started by: supermiguel
4 Replies

3. Shell Programming and Scripting

rsync

hi there I wonder if some-one can help. I am trying to use rsync on my mac to transfer a folder to a remote machine. I have logged into rysnc on my mac no problem and I'm trying to execute this command: rsync -a -e ssh /Users/myname/myfolder/sourcefolder/... (3 Replies)
Discussion started by: volterony
3 Replies

4. Shell Programming and Scripting

rsync

Am I correct in assuming that the following command: rsync -a /a /b does not make any changes on /a if there are files on /b that are newer (2 Replies)
Discussion started by: jgt
2 Replies

5. UNIX for Dummies Questions & Answers

Rsync Help?

Hi everyone, I'm pretty new to rsync and I've been tasked to "fix" an existing .sh to make it work the way I need it to. I have the following rsync set up on a cron job: /usr/local/bin/rsync --stats -qPzrtpl --delete --password-file=/var/run/.appprodrsync ... (2 Replies)
Discussion started by: Russell P
2 Replies

6. Shell Programming and Scripting

Rsync through java program - issues with remote connection failure

Hi Everybody, I am running rsync through my java application. The Java application will sync the files with remote machine. During our connection failure testing we noticed an issue running rsync through java program. The java application which is running at source side is not receiving any... (2 Replies)
Discussion started by: MVEERA
2 Replies

7. UNIX for Dummies Questions & Answers

rsync

Hi all, I'm new to the rsync world in hpux. Currently I have rsync going through the main public lan, but dude to traffic loads, I have been told that i need to use a dedicated rsync lan. I currently have 4 spare nics and the plan was to use one of these for the rsync, but I can't figure out... (2 Replies)
Discussion started by: linuxwanabe
2 Replies

8. Shell Programming and Scripting

Need help on rsync

Hi experts, We need copy 5TB data from one server to another (over a 10Gbps link). We plan to use rsync -av remote:/<path /local on destination server but there're few special requirements like: 1. data copy process should run only from 18:00 Hrs to 07:00 every day until copy is completed. Is... (1 Reply)
Discussion started by: magnus29
1 Replies

9. Shell Programming and Scripting

Facing issues with rsync

Hello Gurus, I am running rsync command to copy certain Directories and files into that directories to remote server. While ruuning the command all teh files has been copied but I am facing error. The below command I am executing to copy Directories and files to remote server: rsync -avrz ssh... (3 Replies)
Discussion started by: pokhraj_d
3 Replies

10. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies
RoPkg::Rsync::Node(3pm) 				User Contributed Perl Documentation				   RoPkg::Rsync::Node(3pm)

NAME
RoPkg::Rsync::Node DESCRIPTION
A node is a rsync module. A node is formed of zero or more atoms. Example: [debian] path = /var/ftp/pub/mirrors/debian.org/ #This comment will show on rsync -v comment = Debian Mirror list = yes [debian] is the node. The node name is debian. The node has 4 atoms: *) param atom (path) *) comment atom (the comment) *) param atom (comment) *) param atom (list) SYNOPSIS
#!/usr/bin/perl use strict; use warnings; sub main { my $node = new RoPkg::Rsync::Node(node_name => 'debian'); $node->AddParam('path', '/var/ftp/pub/mirrors/debian.org'); $node->AddComment('#This comment will show on rsync -v'); $node->AddParam('comment', 'Debian Mirror'); $node->AddParam('list', 'yes'); print $node->ToString(); } main(); The result is: [debian] path = /var/ftp/pub/mirrors/debian.org #This comment will show on rsync -v comment = Debian Mirror list = yes METHODS
All methods, throw the OutsideClass exception, if you use them as class methods. Besides OutsideClass the methods are throwing other exceptions as well. Refer to each method documentation for more information. new(%hash) The constructor of the class. Expects a hash as parameter. At this time, the only valid option is node_name . Any other option will be dis- carded. The node_name is a required parameter. If is not defined, a Param::Missing exception will be raised. Example: my $node = new RoPkg::Rsync::Node(node_name => 'debian'); Add(%atom_details) Add a new atom to the node. The atom details (type, name and value) are keys from the hash. All three parameters must be defined. There are 2 special cases: when the atom is a comment or a blank. In both cases, RoPkg::Rsync::Node generates a name for them. If the atom is a com- ment or a blank the returned value is the name of the atom. If the atom is a parameter, the total number of atoms for this node is returned. Example: $node->Add( type => 'param', name => 'path', value => '/var/ftp/pub/mirrors/debian.org', ); The returned value is the total number of atoms for this node. Example: $node->Add( type => 'comment', value => '#This comment will show on rsync -v', ); The returned value is the name of the atom (the name is autogenerated). Exceptions: *) Param::Missing - $atom_details{type} is not defined *) Param::Wrong = $atom_details{name} or $atom_details{value} are not defined AddParam($pname, $pvalue) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. AddComment($comment_value) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. AddBlank($blank_value) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. GetAtom(%atom_details) Returns a RoPkg::Rsync::Atom object based on parameters specified in %atom_details. The %atom_details fields can be: type, name and value. type and value must be specified. Exceptions: *) Param::Missing - type/name were not specified *) Param::Unknown - no objects were found Take note that only the first object who match the criterias is returned. GetParam($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetComment($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetBlank($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetAll() Returns a array with all the atoms of the node. In scalar context returns the number of atoms. GetAtomsNo() Returns the number of atoms for this node. Has($atom) Returns 1 if the $atom object is already a atom for this node, 0 otherwise. Delete($atom_name) Removes the atom those name is $atom_name. Returns 1 on success (the atom was found and removed), 0 otherwise. Name($node_name) get/set method for node name. Using this method you can change the node name or find it. ToString($indent, $include_node_name) Returns the string representation of the node. If $indent is true, the atoms are indented. If $include_node_name is true, the node name will be included in the string. Example: $node = new RoPkg::Rsync::Node(node_name => 'debian'); $node->AddParam('gid', 'users'); print $node->ToString(0, 0),$/, $node->ToString(0, 1),$/, $node->ToString(1, 1),$/, $node->ToString(),$/; The result is: gid = users [debian] gid = users; [debian] gid = users [debian] gid = users PREREQUISITES
perl 5.008 (or later) is required. Besides perl, you must have the following: *) RoPkg::Exceptions *) Scalar::Util *) English SEE ALSO
RoPkg::Rsync::Atom RoPkg::Rsync::ConfFile RoPkg::Exceptions AUTHOR
Subredu Manuel <diablo@iasi.roedu.net> LICENSE
Copyright (C) 2005 Subredu Manuel. All Rights Reserved. This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The LICENSE file contains the full text of the license. perl v5.8.8 2006-06-09 RoPkg::Rsync::Node(3pm)
All times are GMT -4. The time now is 06:18 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy