06-20-2017
I will write this assuming that the place they are generated/written is Site A and they have clients in Site B.
Even though they two sites may only be 20 miles apart, you may find that there is a much smaller link between the sites. It is common to have 100Mb network at both sites, but only a 2Mb link between them. For small files being read at Site B that is not a problem. The issue is with larger files. I would suggest having a process to get a copy of files to Site B. You could implement some logic like this:-
- When a large file is written to Site A, you should save a timestamp in a reference file and begin a copy to Site B. You can copy however you like, be that (s)ftp, rcp/scp, rsync or anything else that works for you.
- When reading a larger file at site B, read the Site A reference file first and get the timestamp, comparing it with the timestamp of the local file. If the Site B file is up to date, read the local file; if not then read the Site A file.
An alternate may be to remove the Site B file when a new file is written to Site A and atomically copy the file to Site B. That way the Site B client just has to read the Site B file. If that fails (i.e. there is no file) then read the Site A file.
Would either of these work for you?
I hope that it helps,
Robin
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I am facing a weired problem in my FTP script. I want to transfer multiple files from remote server to local server everyday, using mget * in my script. I also, want to send an email for successful or failed FTP. My script works for file transfer, but it don't send any mail. There is... (2 Replies)
Discussion started by: berlin_germany
2 Replies
2. HP-UX
want to remove the thread
thanks (2 Replies)
Discussion started by: indira
2 Replies
3. Shell Programming and Scripting
want to remove this thread.
thanks (2 Replies)
Discussion started by: indira
2 Replies
4. UNIX for Dummies Questions & Answers
Good evening
I need your help pease
I know there are 2 commands(diff, or cp) to compare files in a directory. but the question arises:
1. can i compare zip files or ive got to unzip them?
2. how can i compare 2 files from a local to a remote server? (is there any special commad or ive got... (4 Replies)
Discussion started by: alexcol
4 Replies
5. UNIX for Dummies Questions & Answers
Hi experts,
I 'm newbie to unix world, now I have task to copy the latest files from remote server to my local. I believe this must be very common request in this community. I want you do it one more time for me please.
My requirement is something like this:
I receive files in the below... (3 Replies)
Discussion started by: parpaa
3 Replies
6. Solaris
Hi,
I am trying to automate the process of fetching files from remote server to local server through sftp. I have the username and password for the remote solaris server. But I need to give password manually everytime i run the script.
Can anyone help me in automating the script such that it... (3 Replies)
Discussion started by: ssk250
3 Replies
7. UNIX for Dummies Questions & Answers
Hi All,
I am new to SHell scripting, can someone please help me with the below requirement.
1) LFTP a file to a remote server which supports FTPS. My current enviroment is Sun Solaris 5.10
2) I need to incorporate this in a shell which is currently sending files to a server that accepts... (1 Reply)
Discussion started by: subbu
1 Replies
8. Shell Programming and Scripting
Hi All
I need to transfer a file from a UNIX server to a windows server.
I saw that it is possible to do this using scp command by looking at the forum listed below:
... (2 Replies)
Discussion started by: vx04
2 Replies
9. Shell Programming and Scripting
Hi Guyz ,,
I'm an ERP functional guy , I really need to automate a script which required a shell script but have a little knowledge in shell scripting.
I need my generated files to be zipped first in one directory lets say (xyz) and then it needs to transfer another ftp server in... (3 Replies)
Discussion started by: Shogundion
3 Replies
10. Shell Programming and Scripting
Hi Team,
I am currently working on an integration project where in we have planned to receive files from an external source onto our system via FTPS(SSL). I am new to this part and would like to know the points for consideration and the points to learn to get this done. The files we receive from... (1 Reply)
Discussion started by: Rads
1 Replies
LEARN ABOUT MOJAVE
curlopt_ftp_alternative_to_user
CURLOPT_FTP_ALTERNATIVE_TO_USER(3) curl_easy_setopt options CURLOPT_FTP_ALTERNATIVE_TO_USER(3)
NAME
CURLOPT_FTP_ALTERNATIVE_TO_USER - command to use instead of USER with FTP
SYNOPSIS
#include <curl/curl.h>
CURLcode curl_easy_setopt(CURL *handle, CURLOPT_FTP_ALTERNATIVE_TO_USER,
char *cmd);
DESCRIPTION
Pass a char * as parameter, pointing to a string which will be used to authenticate if the usual FTP "USER user" and "PASS password" nego-
tiation fails. This is currently only known to be required when connecting to Tumbleweed's Secure Transport FTPS server using client cer-
tificates for authentication.
The application does not have to keep the string around after setting this option.
DEFAULT
NULL
PROTOCOLS
FTP
EXAMPLE
TODO
AVAILABILITY
Added in 7.15.5
RETURN VALUE
Returns CURLE_OK if the option is supported, CURLE_UNKNOWN_OPTION if not, or CURLE_OUT_OF_MEMORY if there was insufficient heap space.
SEE ALSO
CURLOPT_FTP_SKIP_PASV_IP(3), CURLOPT_FTP_RESPONSE_TIMEOUT(3),
libcurl 7.54.0 December 21, 2016 CURLOPT_FTP_ALTERNATIVE_TO_USER(3)