rsync - transactional sync with multiple nodes


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting rsync - transactional sync with multiple nodes
# 1  
Old 11-24-2011
rsync - transactional sync with multiple nodes

Hi Everyone,

We have a requirement to sync files with multiple nodes. We need to run the rsync sequentially on each node, if one of the node fails we need to recover the files to previous state in all nodes. I know that we have backup option in rsync which takes the backup of files before applying changes to destination folder.

I have few questions on this
1. How can we achieve the above transactional sync requirement using backup option? Any thoughts...
2.I think rsync performs file by file transfer.. is there any option to take total
backup(--backup) in backup folder first and after complete backup apply changes(sync) with destination?

Thanks !
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Rsync from remote machine via ssh and sync by uisng find by modified time

Hi I have a requirement to rsync from remote to local machine via ssh and sync files that are changed in last n hours. pgrep to check if no other sync is running pgrep -f rsync.*/opt > /dev/null || rsync --bwlimit=10000 -avz --delete root@X.X.X.X:/var/source/ /opt/dest/ >> /home/log 2>&1... (0 Replies)
Discussion started by: robo
0 Replies

2. AIX

HACMP - two nodes - take too long to sync

HI Admin, I have running 2 node HACMP cluster- AIX 6.1. I just set it up. It does sync completely without any errors. But it take too long to sync. More than 30 mins... any reasons? Where can I start looking into ? Same network, same Subnet (1 Reply)
Discussion started by: snchaudhari2
1 Replies

3. Shell Programming and Scripting

Syncing Multiple Music Collections, Can rsync help?

Hello, I have two laptops one office and one personal. The office laptop is a Lenovo T430s 16GB RAM running Windows 7 and the Personal Laptop is a hp Pavilion dm4 Laptop dual booted with Windows 7 and Fedora 14. I have 3 music collections, one on my personal Laptop, one on office Laptop and... (3 Replies)
Discussion started by: ajayram
3 Replies

4. Shell Programming and Scripting

Rsync problem versions out of sync

Hello, I have a report which I am writing as a .tex file, and I am editing from two computers (office and home laptop). I use rsync over ssh connection to synchronise between them and all the rssync commands are written in a Shell script. #synchronise from office computer to home laptop... (2 Replies)
Discussion started by: ajayram
2 Replies

5. Solaris

How to sync without rsync?

rsync for solaris seems to be a spotty beast. It's not installed by default. I facing a problem where I didn't have root access to be able install rsync. I did have ssh access and was able to configure the authorized keys so that no password was required to connect from one server to another. ... (1 Reply)
Discussion started by: abe123
1 Replies

6. Shell Programming and Scripting

rsync multiple directories into single directory on remote

I would like to find and backup all *.mp4 files from /Pictures and its sub-directories and move them to a single directory on a remote. I can find and move the files but I don't want the directory structure...just the files to be placed in a single remote directory. To find my files I use ... (1 Reply)
Discussion started by: wreckedred
1 Replies

7. Emergency UNIX and Linux Support

rsync transferring multiple files issue

Hi, I want to specify multiple remote directories but want to transfer them in a single command with one connection with remote server. This avoids entering passwords repeatedly and is also efficient. e.g. rsync -vrt --size-only --delete user@host:/home/user1/dir1... (9 Replies)
Discussion started by: sardare
9 Replies

8. Shell Programming and Scripting

rsync multiple remote directories one connection

Hi, I want to specify multiple remote directories but want to transfer them in a single command with one connection with remote server. e.g. rsync -vrt --size-only --delete user@host:/home/user1/dir1 user@host:/home/user1/dir2 user@host:/home/user1/dir3 .... local_dir/ I want to... (0 Replies)
Discussion started by: sardare
0 Replies
Login or Register to Ask a Question
MRB(8)							      System Manager's Manual							    MRB(8)

NAME
mrb - manage incremental snapshots with rsync/make. SYNOPSIS
mrb command DESCRIPTION
mrb is a simple aid to creating efficient incremental snapshots of a set, or sets, of directories whenever that may be required. It may be used as part of a regular automated backup regime, or for manually checkpointing changes at convenient points in time. COMMANDS
The following commands are recognised (where 'MODULE' is the name of one of your snapshot definitions): new-MODULE Create a skeleton definition for a new snapshot 'MODULE'. dest-MODULE Create the destination dir for 'MODULE'. This directory must exist to create a snapshot. snap-MODULE Create a snapshot of 'MODULE'. sync Create snapshots of all defined modules. If run as root this may be configured to include the modules of other users too (see MRB_SYNC_USERS in ~/.mrb/defaults). help Show mrb's own help text. CONFIGURATION FILES
Per-user configuration The following files may be used to specify global and local configuration options. /etc/default/mrb system default configuration. ~/.mrb/defaults per-user configuration. Per-user options The following options control behaviour for all of a user's modules. MRB_SNAPSHOT_LOG An optional file path where transfer details will be recorded. If unset these details will not be logged. MRB_SYNC_USERS A space separated list of users whose modules should be included in a sync. This is mostly only useful for root, as mrb will assume the identity of each user before creating snapshots of their modules. If unset, only the invoking user's modules will be sync'ed. MRB_CONFDIR An space separated list of the directories to search for module definition (*.mrc) files. They will be searched in the order given, with new modules added by default to the last one listed. There should be few reasons to change the default value. Per-module configuration The default MRB_CONFDIR value will search for module definitions in: /etc/mrb/*.mrc ~/.mrb/*.mrc Those created by new-MODULE will be placed in this latter location by default. Per-module options In each case module below is the name of the particular module that the value set should apply to. These options should be defined in a file named module.mrc. module_SRC A space separated list of the files and (top level) directories to include in the snapshots for this module. module_DEST The directory root where snapshots of module should be stored. module_INCLUDE An optional list of rsync(1) include patterns. module_EXCLUDE An optional list of rsync(1) exclude patterns. module_FILTER An optional list of rsync(1) filter patterns. module_FILTER_FILE An optional filename for rsync(1) dir-merge filtering support. module_RSYNC_OPTIONS Optional additional rsync(1) options to pass verbatim when it is invoked. module_PRECOMMAND An optional shell command to invoke just prior to creating a new snapshot. If the command does not return a successful exit status, then the snapshot creation will be aborted before it begins. It may be used to mount removable media or similar. module_POSTCOMMAND An optional shell command to execute after making the snapshot. It will not be called if the snaphot creation failed at an earlier stage, and its return status may halt a sync operation if it fails with more modules still to process. It may be used, for example, to unmount removable media again. module_USER An optional user name to check that mrb is running as before performing a snapshot. This can be used to ensure you have the correct permisson to access the files being mirrored before you get too far. SEE ALSO
rsync(1), make(1). AUTHOR
mrb was written by Ron <ron@debian.org>. May 9, 2006 MRB(8)