remote directories synchronization


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users remote directories synchronization
# 1  
Old 08-21-2007
remote directories synchronization

Hi ALL,

We have 2 Linux boxes that are remote to each other. We need to achieve folder synchronization like whatever we keep in a folder (specific) on Server-A which needs to be replicated to Server-B's respective folder. The requirements are below
- Secure transfer (encrypted)
- File Compression during transfer
- Resume broken transfer (in case there is connectivity failure or any other break after transferring 50% (500MB - e.g.) of a 1GB size (e.g.). Next time when it is run, it should resume the file and download remaining 500MB part only.
- Authentication
- Detailed Logs containing transferred files (or failed also with reason), time stamp and source/destination folders, server names.

Though there're few commercial software on Windows (or may be even on Linux), we have to implement by ourselves using shell scripting on Linux only. Though RSYNC is the best option but it fails to provide “resume broken transfers”.

Could anyone please suggest any way/tools/packages/technique to achieve this?

Thanks in Advance
Prvn
# 2  
Old 08-21-2007
overall, rsync seems to suit best your needs, the only secure application that I can think of, for "Resume broken transfer" is sftp transfer.
# 3  
Old 08-21-2007
Thanks sysgate.

But how could i use SFTP to resume broken transfer? I simulated this and got the entire file re-transferred.


Prvn
# 4  
Old 08-22-2007
My bad, I've always thought that resuming is supported, because I'm using some in-house modified tools, etc. Sorry for the confusion. Here's an article related to this matter, HTH.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare Directories and folders on two remote lpar

Hello, i'm trying to script to compare the same directory on the lpar. The problem is i'm using the command : find /etc -type d -ls but i cannot reach the remote lpar. I have another solution to put that command in a text file and compare with Excel. but i could be fine to have the... (7 Replies)
Discussion started by: steiner
7 Replies

2. Homework & Coursework Questions

Synchronization process

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: it is assumed that the five processes are available according to the graph (cycle is formed of five process). ... (1 Reply)
Discussion started by: mariam40
1 Replies

3. Solaris

I need to synchronization by rsync

Hi everyone! I wonder about the rsync. The purpose I just want: synchronization from server 1 to server 2 by rsync, example: Node 1: /app/logs/* Node 2: /app/logs/* in Node 1 when I used rsync -aru /app/logs/ node2:/app/logs/, then everything will be copied and update to node 2. But,... (1 Reply)
Discussion started by: trantuananh24hg
1 Replies

4. Shell Programming and Scripting

rsync multiple directories into single directory on remote

I would like to find and backup all *.mp4 files from /Pictures and its sub-directories and move them to a single directory on a remote. I can find and move the files but I don't want the directory structure...just the files to be placed in a single remote directory. To find my files I use ... (1 Reply)
Discussion started by: wreckedred
1 Replies

5. Shell Programming and Scripting

rsync multiple remote directories one connection

Hi, I want to specify multiple remote directories but want to transfer them in a single command with one connection with remote server. e.g. rsync -vrt --size-only --delete user@host:/home/user1/dir1 user@host:/home/user1/dir2 user@host:/home/user1/dir3 .... local_dir/ I want to... (0 Replies)
Discussion started by: sardare
0 Replies

6. UNIX for Dummies Questions & Answers

Server Synchronization

I am new on UNIX system. I am administrating a server belongs to a small department. It has Debian installed, and used as mail, web server. I am trying to synchronize to a different machine which has Fedora installed. Can anybody tell me how to copy exact image of one server to a different for ... (3 Replies)
Discussion started by: kumarrana
3 Replies

7. AIX

Date Synchronization

I want to synchronize my AIX 5.3 server with the server NTP windows using the ntpdate commande but there was a difference about 9 hours after synchro. here is my script and the result # date Tue Apr 10 18:58:06 CDT 2007 # ntpdate 192.168.10.212 10 Apr 09:58:19 ntpdate: step time server... (5 Replies)
Discussion started by: tovohery
5 Replies

8. UNIX for Advanced & Expert Users

Synchronization of 2 directories

I have 2 hosts (server and client), on the client side I mount remote directory (through NFS). How can I synchronize content of 2 directories (one on the client, and one on the server, mounted to the client)? i.e. when client is connected to the server synchronization process is automatically... (5 Replies)
Discussion started by: Hitori
5 Replies

9. Shell Programming and Scripting

export display of directories of remote machine

hi I wanted to export the display of all directories of home with their respective subdirectories and files if any on my local pc. this home directory is of some remote machine . using ssh remote login and then using struct direct i can just gate name list of directories . but not the display... (2 Replies)
Discussion started by: bhakti
2 Replies

10. UNIX for Dummies Questions & Answers

Date synchronization

Hi all Is there an easy way to synchronize the time of a Linux server with another server (Linux or Windows). I need to do this on a daily basis so that my clock does is insync. Is synchronizing with an eternal server hazardous to the security of the box? Thanks in advance KS (2 Replies)
Discussion started by: skotapal
2 Replies
Login or Register to Ask a Question