I'm facing some issue while syncing data using lsyncd. I'm working on a project to migrate data from a source S3 bucket to target S3 bucket. Both buckets has been configured via AWS storage gateway and shared to Linux servers as nfs shares.
The data size on below servers are:
Server A : approx 2 TB
Server B : approx 8 TB
Server C : approx 25 TB
NFS shares :
Server A : (src-nfsshare1, tgt-nfsshare2)
Server B : (src-nfsshare3, tgt-nfsshare4)
Server C : (src-nfsshare5, tgt-nfsshare6)
Our approach of data migration is, to mount the source S3 (src nfs share x) and target S3 (tgt nfs share x) on each server.
I've used tar command to copy the initial full copy of data which was quite quicker than rsync.
It took me 2 months to complete the full copy process. Now, I've setup lsyncd to replicate the delta data as soon as the source have new/updated data. I preferred lsyncd preffered over rsync (scheduling via cron).
Now, for "Server A" it works fine. I can see the logs are updating and showing the data being updated.
Logs Server A:
Lsyncd Configuration:
- Increased the below value from default to 150000 which worked for me. Reason, getting error "Consider increasing /proc/sys/fs/inotify/max_user_watches" while lsyncd initiating the sync.
But for server B and C, though lsyncd doesn't throw any error but I think there is some issue. Actually, the server has been started since yesterday but seems it is not doing anything.
Lsyncd configuration for server B & C is same a above (only the src & tgt paths are different).
Here I set inotify watches a little high because till 500000, it was failing.
Lsyncd logs for Server A & B are same:
Its more than 25 hours but nothing logged in the log files. /etc/lsyncd.status file also blank. Can anybody shade light on this?
Also, I'm looking to add other rsync option with lsyncd (i.e. --stats, --progress or --progress2=info). How can I do that?
How to redirect the errors which occurred during file syncing operation (i.e. io errors or timeout errors) to a separate log file?
Can anyone please tell me anything about the following:
AIX O/S - IBM RS6000 server
I want to know where I can go to check and see how much RAM is intalled in the server, how many Processors are installed in the server, and how I can run a sar command to show me processor statistics?
I... (4 Replies)
HEllo,
I try to Launch OOO, but I have X configuration problem.
I 'm searching in man pages but if someone can help me...
Of course I set the DISPLAY as explain in the man page but with no more result: setenv DISPLAY myws:0
Thanks in advance (1 Reply)
Discussion started by: SoulCoder
1 Replies
3. Post Here to Contact Site Administrators and Moderators
I have an RS/6000 running AIX 5.3. I would like to get either dhcp client working or assigning it an ip would be fine as well. I have tried using smit to do it many times trying different things, and I can get an ip assigned but it doesn't communicate with the network or internet. I haven't been... (3 Replies)
I have installed openldap-servers package in server machine
i have edited vi /etc/openldap/ldap.conf
i have added following line
BASE dc=abcd,dc=com
URI ldap://ldap.abcd.com ldap://ldap-master.abcd.com:666
i have restarted the ldap service
then client pc i have installed... (0 Replies)
Hi, i have to configure postfix in this mode:
- if i receive a mail from a@a.a relay to
- if i receive a mail NOT from a@a.a relay the mail to user "test" that is on localhost
For the first rule i do this in main.cf:
sender_dependent_default_transport_maps = hash:/etc/postfix/sender_check... (0 Replies)