Sponsored Content
Full Discussion: Lsyncd Configuration
Top Forums UNIX for Beginners Questions & Answers Lsyncd Configuration Post 303038591 by stomp on Friday 6th of September 2019 04:54:45 PM
Old 09-06-2019
I used lsyncd to migrate(p2v) servers to minimize downtime when migrating. Had lot's of files(1K-1M).

Like plain rsync it's good for a lot of things. It's very bad for syncing big files which change often(-> big database files), because lsyncd will constantly syncing those big files if only one byte changes. ( I had ~100 smaller mysql databases on some server. This worked fine.)

Worked like charm. You can apply rsync args with rsync/_extra:

Code:
sync {
    default.rsync,
    source    = "/",
    target    = "1.2.3.42:/disk/",
    exclude   = {
                "/proc/**",
                "/sys/**",
                "/dev/**"
                },
    rsync     = {
        archive  = true,
        _extra  = { "-v", "-H", "--numeric-ids" }
    }
}

Update:
Since you copy files from nfs to nfs I recommend to check disabling the Delta-Transfer with -W.

If not lsyncd/rsync will read the whole file from the source-nfs before transferring the 5 (Bytes? MBytes? GBytes?) that have changed.


The above is default, when - like in this case - both source and target path are local(begin with /).

If you have so many files and access it via nfs the initial phase is of course taking long. (I had backup issues of servers with 4-8 million files, took 10-30 hours for an rsync backup to take place even if little changed - and that was with a local source). This should be either with lsyncd or rsync. But I'm curious if plain rsync is faster.

If you just have vanishing many files, this should not cause heavy load.

I think there's not so much difference between lsyncd and rsync. Because the former is just like a wrapper of the latter.

Last edited by stomp; 09-07-2019 at 09:09 AM..
 

8 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Configuration

Can anyone please tell me anything about the following: AIX O/S - IBM RS6000 server I want to know where I can go to check and see how much RAM is intalled in the server, how many Processors are installed in the server, and how I can run a sar command to show me processor statistics? I... (4 Replies)
Discussion started by: Docboyeee
4 Replies

2. BSD

X configuration

HEllo, I try to Launch OOO, but I have X configuration problem. I 'm searching in man pages but if someone can help me... Of course I set the DISPLAY as explain in the man page but with no more result: setenv DISPLAY myws:0 Thanks in advance (1 Reply)
Discussion started by: SoulCoder
1 Replies

3. Post Here to Contact Site Administrators and Moderators

configuration

how to configure servor dns on windows servor 2003 (0 Replies)
Discussion started by: djest
0 Replies

4. Linux

configuration

hello, I don't know how to configure servor dns on linux,please help I thanck YOU (1 Reply)
Discussion started by: djest
1 Replies

5. AIX

Need help on IP Configuration

I have an RS/6000 running AIX 5.3. I would like to get either dhcp client working or assigning it an ip would be fine as well. I have tried using smit to do it many times trying different things, and I can get an ip assigned but it doesn't communicate with the network or internet. I haven't been... (3 Replies)
Discussion started by: izzzy
3 Replies

6. SCO

printer configuration

Dear all i have install printer in sco open 5 , i m not getting print out , but printing is showing in que plz help (7 Replies)
Discussion started by: sudhir69
7 Replies

7. Red Hat

LDAP configuration

I have installed openldap-servers package in server machine i have edited vi /etc/openldap/ldap.conf i have added following line BASE dc=abcd,dc=com URI ldap://ldap.abcd.com ldap://ldap-master.abcd.com:666 i have restarted the ldap service then client pc i have installed... (0 Replies)
Discussion started by: ainstin
0 Replies

8. UNIX for Advanced & Expert Users

Postfix Configuration

Hi, i have to configure postfix in this mode: - if i receive a mail from a@a.a relay to - if i receive a mail NOT from a@a.a relay the mail to user "test" that is on localhost For the first rule i do this in main.cf: sender_dependent_default_transport_maps = hash:/etc/postfix/sender_check... (0 Replies)
Discussion started by: certo85
0 Replies
vzmigrate(8)							    Containers							      vzmigrate(8)

NAME
vzmigrate - migrate a container between two OpenVZ servers SYNOPSIS
vzmigrate [-r|--remove-area yes|no] [--ssh=ssh_options] [--rsync=rsync_options] [--keep-dst] [--online] [-v] destination_address CTID DESCRIPTION
This utility is used to migrate a container from one (source) Hardware Node (HN) to another (destination) HN. The utility can migrate either stopped or running container. For a stopped container, simple CT private area transfer is performed (rsync(1) is used for file transfer). For running containers, migration may be offline (default) or online. This program uses ssh as a transport layer. You will need to put ssh public key to destination node and be able to connect to node without entering password. OPTIONS
-r, --remove-area yes | no Whether to remove a container area on source HN for the successfully migrated container. Default is yes. --ssh=options Additional options that will be passed to ssh while establishing connection to destination HN. --rsync=options Additional options that will be passed to rsync(8). You may add options like -z to enable data compression if you are migrating over a slow link. --keep-dst Do not clean synced destination container private area in case of some error. It makes sense to use this option on big container migration to avoid syncing container private area again in case some error (on container stop for example) occurs during first migration attempt. --online Perform online (zero-downtime) migration: during the migration the container hangs for a while and after the migration it continues working as though nothing has happened. -v Verbose mode. Causes vzmigrate to print debugging messages about its progress. Multiple -v options increase the verbosity. The maximum is 3. EXAMPLES
Migration of CT 101 to 192.168.1.130 with downtime: vzmigrate 192.168.1.130 101 Online migration of CT 102 to 192.168.1.130: vzmigrate --online 192.168.1.130 102 EXIT STATUS
0 EXIT_OK Command completed successfully. 1 EXIT_USAGE Bad command line options. 2 EXIT_VE_STOPPED Container is stopped. 4 EXIT_CONNECT Can't connect to destination (source) HN. 6 EXIT_COPY Container private area copying/moving failed. 7 EXIT_VE_START Can't start or restore destination CT. 8 EXIT_VE_STOP Can't stop or checkpoint source CT. 9 EXIT_EXISTS Container already exists on destination HN. 10 EXIT_NOTEXIST Container does not exists on source HN. 12 EXIT_IP_INUSE You attempt to migrate CT which IP address(es) are already in use on the destination node. 13 EXIT_QUOTA Operation with CT quota failed. SEE ALSO
rsync(1). COPYRIGHT
Copyright (C) 2001-2010, Parallels, Inc. Licensed under GNU GPL. OpenVZ 28 Jun 2011 vzmigrate(8)
All times are GMT -4. The time now is 06:06 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy