Sponsored Content
Top Forums UNIX for Advanced & Expert Users Best way to transfer files to remote FTPS server instead of local FTPS server Post 302999143 by rbatte1 on Wednesday 14th of June 2017 06:51:26 AM
Old 06-14-2017
Jim's suggestion is a good one, however if they are large files and you read them more than a few times, then you might just create yourself a bottleneck. For a read once on each client, then use Jim's suggestion.

Perhaps your write to the central file server would be best done with rsync so that only data that has changed gets written across the network each time you need to update it, assuming that the source file is not removed & re-written each time.

You also have to consider how your clients will behave if the file is incomplete when they try to read it. Perhaps a flag file on the central server so that the other clients will only read a file when it's present. Your write process would then need to delete/rename the flag file before it starts re-writing the data file and then recreate it when it is complete.

When you say that the files are remote, if you mean physically remote (different city/country etc.) then your biggest issue will be the network link.

Some things to consider:-
  • Where is the data source?
  • Where are the clients?
  • How much data are we talking?
  • How often will it be written?
  • How often will it be read?
  • Will a file be ignored if has not been updated?
  • What is the network like?
These need to be answered however you choose to implement this.

There are (probably expensive) technologies that can replicate data between remote sites if that is your need, but it then depends on what you have already available, e.g. SANs, ZFS/NAS, etc.


Can you expand a little more on these?




Kind regards,
Robin
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

FTP multiple files from remote server to local server

Hi, I am facing a weired problem in my FTP script. I want to transfer multiple files from remote server to local server everyday, using mget * in my script. I also, want to send an email for successful or failed FTP. My script works for file transfer, but it don't send any mail. There is... (2 Replies)
Discussion started by: berlin_germany
2 Replies

2. HP-UX

Transfer file from local unix server to remote server

want to remove the thread thanks (2 Replies)
Discussion started by: indira
2 Replies

3. Shell Programming and Scripting

Transfer file from local unix server to remote server

want to remove this thread. thanks (2 Replies)
Discussion started by: indira
2 Replies

4. UNIX for Dummies Questions & Answers

compare zip files from a local to remote server

Good evening I need your help pease I know there are 2 commands(diff, or cp) to compare files in a directory. but the question arises: 1. can i compare zip files or ive got to unzip them? 2. how can i compare 2 files from a local to a remote server? (is there any special commad or ive got... (4 Replies)
Discussion started by: alexcol
4 Replies

5. UNIX for Dummies Questions & Answers

How to copy files from remote server to local?

Hi experts, I 'm newbie to unix world, now I have task to copy the latest files from remote server to my local. I believe this must be very common request in this community. I want you do it one more time for me please. My requirement is something like this: I receive files in the below... (3 Replies)
Discussion started by: parpaa
3 Replies

6. Solaris

Script to get files from remote server to local server through sftp without prompting for password

Hi, I am trying to automate the process of fetching files from remote server to local server through sftp. I have the username and password for the remote solaris server. But I need to give password manually everytime i run the script. Can anyone help me in automating the script such that it... (3 Replies)
Discussion started by: ssk250
3 Replies

7. UNIX for Dummies Questions & Answers

Lftp for a remote server which uses FTPS

Hi All, I am new to SHell scripting, can someone please help me with the below requirement. 1) LFTP a file to a remote server which supports FTPS. My current enviroment is Sun Solaris 5.10 2) I need to incorporate this in a shell which is currently sending files to a server that accepts... (1 Reply)
Discussion started by: subbu
1 Replies

8. Shell Programming and Scripting

Do I require remote login access to a windows server to transfer files from a UNIX server

Hi All I need to transfer a file from a UNIX server to a windows server. I saw that it is possible to do this using scp command by looking at the forum listed below: ... (2 Replies)
Discussion started by: vx04
2 Replies

9. Shell Programming and Scripting

Shell scripting to transfer files from one to another server through ftps

Hi Guyz ,, I'm an ERP functional guy , I really need to automate a script which required a shell script but have a little knowledge in shell scripting. I need my generated files to be zipped first in one directory lets say (xyz) and then it needs to transfer another ftp server in... (3 Replies)
Discussion started by: Shogundion
3 Replies

10. Shell Programming and Scripting

File transfer using FTPS(SSL)

Hi Team, I am currently working on an integration project where in we have planned to receive files from an external source onto our system via FTPS(SSL). I am new to this part and would like to know the points for consideration and the points to learn to get this done. The files we receive from... (1 Reply)
Discussion started by: Rads
1 Replies
mkxauth(1x)							Linux User's Manual						       mkxauth(1x)

NAME
mkxauth - create and merge .Xauthority files SYNOPSIS(1) mkxauth [ -q ] [ -u login ] -c [ host [ host ... ] ] (2) mkxauth [ -q ] [ -u login ] -m login(3) mkxauth [ -q ] [ -u login ] -f host(4) mkxauth [ -q ] [ -u login ] -r host [ -l login ] (5) mkxauth [ -q ] [ -u login ] -z host [ -l login ] DESCRIPTION
mkxauth aids in the creation and maintenance of X authentication databases (.Xauthority files). Use it to create a ~/.Xauthority file or merge keys from another local or remote .Xauthority file. Remote .Xauthority files can be retrieved via FTP (using ncftp(1)) or via rsh(1). For a slight measure of security, mkxauth does not create any temporary files containing authentication keys (although anyone spy- ing on network packets can see the authentication key data as they pass through the network; for secure network communications, use ssh(1)). Creating and Adding to a .Xauthority File To create a .Xauthority file, use mkxauth -c (see(1) above). mkxauth creates a .Xauthority file in the user's home directory (~/), con- taining a `key' or `magic cookie' for the host it was run on (the one returned by hostname(1)). If a .Xauthority file already exists, the keys are added to it. If keys for that host already exist, they are replaced. To create or add to a .Xauthority file for another user, use mkxauth -u login -c. mkxauth adds keys to ~login/.Xauthority (only the root user is allowed to do this). To add a key for more than one host, specify all hosts on the command line: mkxauth -c daffy porky bugs. All hosts specified on the same command line receive the same key. To create different keys for multiple hosts, run mkxauth for each host in succession: mkxauth -c daffy mkxauth -c porky mkxauth -c bugs Merging Keys from Local .Xauthority Files To merge keys from another local user's .Xauthority file, use mkxauth -m login (see(2) above). mkxauth adds the keys in ~login/.Xauthor- ity to ~/.Xauthority, replacing any keys which already exist. ~login/.Xauthority must be readable by the user running mkxauth (normally only the root user can read other people's .Xauthority files). Merging Keys via FTP To merge keys from a remote .Xauthority file via FTP, use mkxauth -f host (see(3) above). mkxauth retrieves the remote .Xauthority from host using ncftp(1) and adds those keys to ~/.Xauthority, replacing any keys which already exist. [NOTE: you must have a ~/.netrc file set up to automatically log you into host, otherwise the FTP login attempt will fail.] Merging Keys via rsh(1) To merge keys from remote .Xauthority file via rsh(1), use mkxauth -r host (see(4) above). mkxauth retrieves the remote .Xauthority from host using rsh(1) and adds those keys to ~/.Xauthority, replacing any keys which already exist. To login as a different user, use -l login. [NOTE: you must have a .rhosts file set up properly for this to work, otherwise the remote login attempt will fail]. Merging Keys via rsh(1) and gzip(1) If your remote .Xauthority file is large, or to make it slightly less obvious that you're transferring authentication keys over the net- work, mkxauth can gzip(1) your .Xauthority file before retrieving it via rsh(1). To do this, use mkxauth -z host (see(5) above). mkxauth retrieves the remote .Xauthority from host using rsh(1) and adds those keys to ~/.Xauthority, replacing any keys which already exist. To login as a different user, use -l login. [NOTE: you must have a .rhosts file set up properly for this to work, otherwise the remote login attempt will fail]. Options To make mkxauth operate quietly, use the -q option. To add to ~login/.Xauthority, use the -u login option. To use login for the remote login in mkxauth -f, mkxauth -r, and mkxauth -z, use the -l login option. Getting Help To get quick help about mkxauth, use mkxauth --help. FILES
~/.Xauthority ~/.netrc ~/.rhosts COMMENTS
mkxauth is mostly useful for maintaining .Xauthority files in an environment which uses startx(1x). xdm(1x) uses its own method of gener- ating .Xauthority files. However, mkxauth is still useful for transferring .Xauthority information to remote login sessions so that the user can display remote X clients on the local host without too much trouble. Note, however, that using rsh(1) is inherently insecure, and sites concerned about security should use ssh(1) instead (see http://www.cs.hut.fi/ssh/ for more information). SEE ALSO
X(1x), Xsecurity(1x), gzip(1), mcookie(1), md5sum(1), ncftp(1), rsh(1), startx(1x), xauth(1x), xdm(1x) BUGS
Does not respect the XAUTHORITY environment variable. AUTHOR
Conceived and written by Jim Knoble <jmknoble@redhat.com>. Copyright 1996 by Jim Knoble and Red Hat Software. Distributed under the GNU GPL (General Public License); see ftp://prep.ai.mit.edu/pub/gnu/COPYING for more information. Red Hat Software 12-Dec-1996 mkxauth(1x)
All times are GMT -4. The time now is 11:12 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy