Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: FTP/SFTP/SCP Files
Top Forums Shell Programming and Scripting FTP/SFTP/SCP Files Post 302594941 by methyl on Wednesday 1st of February 2012 02:53:13 PM
Old 02-01-2012
For file transfers "ftp" or "sftp" is usually a last resort when transferring files to incompatible or isolated platforms. If you have the opportunity to use "rcp" or "scp" backed with processing in Remote Shell this is preferable.

Assuming you only have "ftp" or "scp" the common techniques are:
1) Transfer each file under a temporary name and then rename the files to their correct names after the last transfer has finished.
2) Include a verifiable control record in the data file design.
3) Transfer a batch header file first which itemises filenames and checksums for the remote computer to check. (This assumes some compatibility between the computers).
4) Compress the file before transfer into a verfiable archive.

Obviously your "ftp" script needs proper error handling but I'd first look at why the transfers are failing and then how to deal with it. In my experience the most common "ftp" problem is the "mysterious hang" or "crawling speed" when transferring across a modern high-speed WAN.

Ps. Just scanned some of your earlier posts. Can you post the actual script because I see no error handling?
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

sftp vs scp

My transmit rates are waaay faster using scp over sftp....anyone know why scp is faster than sftp? I am using solaris 8 for my unix systems. -S (2 Replies)
Discussion started by: Sowser
2 Replies

2. UNIX for Dummies Questions & Answers

File Missing When Grabbing Files from SFTP Server using SCP Command

Hi, I have this problem where sometimes my files would go missing when I schedule my crontab to run the SCP command to get file from the SFTP server. My crontab will run the scripts at an interval of 3 minutes (between the two scripts) The following is the setting in my crontab. ... (1 Reply)
Discussion started by: gingervitus
1 Replies

3. AIX

what to use sftp or scp

hi, i have a weird problem i have to copy the file with caret(^) in it. but when i tries to copy with scp. It(scp) says that it cant use ^file_name scp mohit^narang user@machine/mohit^narang the error comes in the second parameter.if i used user@machine/mohit_narang(under score) instead... (2 Replies)
Discussion started by: narang.mohit
2 Replies

4. Shell Programming and Scripting

Error copying files from Unix (Solaris10) to Windows Server 2003 using scp/sftp

Hi, I have generated a Public/Private Key Pair in Solaris Unix (source) server and deployed the Public key in Windows 2003(target) server .ssh directory of user profile. When i try to connect(ssh, scp, sftp) from Unix, i'm getting below error message. Sun_SSH_1.1, SSH protocols 1.5/2.0,... (0 Replies)
Discussion started by: ajaykumarb
0 Replies

5. SuSE

scp/sftp only files which are not found.

Hi, I need to write a script to scp/sftp files from server A to server B..But i do not want to overwrite the files which already exist on server B. Anyone has a script which does the above Regards (2 Replies)
Discussion started by: SystemEng
2 Replies

6. Shell Programming and Scripting

SFTP and SCP help

Hi All, I have to make an automated script that needs to do SFTP or SCP from my Unix server to another Unix server. I have gone through search of this website for sftp and scp. I really get confused when it talk about ssh key or rsh key and sftp -b thing I would really appreciate if... (4 Replies)
Discussion started by: pinnacle
4 Replies

7. Shell Programming and Scripting

Transfer files from linux server to windows using secure ftp (sftp)

HI, I have to transfer files from linux server to windows using secure ftp (sftp) .Kindly help me out. (3 Replies)
Discussion started by: manushi88
3 Replies

8. Solaris

How do files transferred via ftp or sftp gets thier permissions at destination?

We have umask defined under /etc/.login as 022. I have my user specific umask defined in /userhome/.login as 002. I understand ftp will not execute anything at destination, it simply transfers files. But it seem to be using 022 as umask for the files transferred. How does ftp knows what umask... (4 Replies)
Discussion started by: kchinnam
4 Replies

9. IP Networking

How to transfer files from UNIX server to windows machine or vice versa using ftp or sftp commands?

hi, i want to write a shell script code which transfers files from a directory in unix server to a directory in a windows machine.. can any1 give me a sample code which uses ftp or sftp command.. thanks very much, (3 Replies)
Discussion started by: Little
3 Replies

10. Shell Programming and Scripting

How can we overcome Broken pipe error during scp,SFTP,Rsync while transferring big files.?

Hello All, Hope all are doing well. We use scp (some times sftp and rsync also) for transferring big files (around 2GB each ) from 1 Network to another Network. The Issues which we face :- During transfer some times( Once in 1 week (or twice)) , the speed of transfer gets down to 30 kb/s,... (2 Replies)
Discussion started by: Upendra Bhushan
2 Replies

LEARN ABOUT CENTOS

ftpusers

FTPUSERS(5)						     Linux Programmer's Manual						       FTPUSERS(5)

NAME

       ftpusers - list of users that may not log in via the FTP daemon

DESCRIPTION

       The  text  file	ftpusers  contains a list of users that may not log in using the File Transfer Protocol (FTP) server daemon.  This file is
       used not merely for system administration purposes but for improving security within a TCP/IP networked	environment.   It  will  typically
       contain	a  list  of  the  users that either have no business using ftp or have too many privileges to be allowed to log in through the FTP
       server daemon.  Such users usually include root, daemon, bin, uucp, and news.  If your FTP server daemon doesn't use ftpusers  then  it	is
       suggested  that	you  read  its	documentation  to find out how to block access for certain users.  Washington University FTP server Daemon
       (wuftpd) and Professional FTP Daemon (proftpd) are known to make use of ftpusers.

   Format
       The format of ftpusers is very simple.  There is one account name (or username) per line.  Lines starting with a # are ignored.

FILES

       /etc/ftpusers

SEE ALSO

       passwd(5), proftpd(8), wuftpd(8)

COLOPHON

       This page is part of release 3.53 of the Linux man-pages project.  A description of the project, and information about reporting bugs,  can
       be found at http://www.kernel.org/doc/man-pages/.

Linux								    2000-08-27							       FTPUSERS(5)
All times are GMT -4. The time now is 09:01 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy