FTP run from shell script gives slow transfer rates Post: 302304959

Sponsored Content

Top Forums Shell Programming and Scripting FTP run from shell script gives slow transfer rates Post 302304959 by Countificus on Tuesday 7th of April 2009 04:13:47 PM

04-07-2009

Registered User

When I run the script or run ftp manually, I have a PuTTY session open to the destination server and directory so that I can see the progress. From the script it takes approximately 6 minutes to transfer 1GB of data. When run interactively 1GB transfers in about 40 seconds.

Everything should be the same. FTP works from the script, it just behaves like it has been throttled. One more thing I thought of, our production server runs a script every 3 minutes during the first 10 days of the month that polls for ftp connections where data files are being submitted by our customers. I wonder if the previous admin (who did not document anything Smilie

) added something to the config which is throttling the bandwidth on non-interactive ftp connections?

What exactly does set-x do? I am pretty green, but I am catching on fast. I was a Windoze AD and Exchange admin for 10 years before I got this job and have been in the UNIX world for about 6 months.

Last edited by Countificus; 04-07-2009 at 05:31 PM..

Countificus

View Public Profile for Countificus

Find all posts by Countificus

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

script to be run after every FTP transfer

Hello everyone, we are running VSFtpd as FTP Server on Redhat AS 5. I would like to have a script to be run immediately after every FTP transfer. Is is possible (or with any other FTP Server?). I thought of writing a script to monitor if FTP transfer happening and run the required-script...

2. Shell Programming and Scripting

Script for FTP (transfer only new files)

Hi everybody, I just want to transfer files with FTP (mget and mput). The problem is that I dont want to overwrite any existing files and don't want to transfer them again (e.g. using the rename-function). So I only want to transfer new files with mget and mput. My first idea was to create...

3. Shell Programming and Scripting

RSYNC script to transfer folders recursively without overwriting via FTP

Hi all, I would need a bash script to sync/transfer folders recursively via FTP/RSYNC (I initially planned to use FTP but I heard RSYNC would fit a lot better for this job(?)) The situation: 3 different Linux servers 1. source 2. destination - Samba 3. Server where the script runs on ...

4. UNIX for Dummies Questions & Answers

Very SLOW STFTP transfer rate

Hi, I am experiencing extremely show transfer rates when transferring zip files over SFTP. Over FTP it works fine. I have disabled compression in the sshd_config file but that does not seem to help.. Any ideas?

5. Windows & DOS: Issues & Discussions

to run shell script using FTP

Hi All, From FTP prompt, How to run Unix Shell scripts? Thanks in Advance,

6. Shell Programming and Scripting

How to run a shell script on a remote host using ftp

Hi, is there a way I can run a shell script through ftp on a remote host? The remote host doesn't have ssh running so I can't use ssh.

7. Shell Programming and Scripting

Shell Scripting for creating ftp and transfer file

Dear All, We run backup script to update backup file every hour. I want to create a script, which transfer these files in another server using ftp as new backup file created every hour. Files should be stored with a unique name for every hour(e.g 20130708_13:00 , 20130708_14:00 and so on) and...

8. UNIX for Dummies Questions & Answers

To run ksh script via autosys job without asking password for file transfer

I've K shell script. It will transfer the files from one server to other server using 'SCP' command. While running the script alone as a command line in UNIX ssh terminal its running with out asking password and files are transferred with out asking for password. But by running the script using...

9. Shell Programming and Scripting

Shell script reading file slow

I have shell program as below #!/bin/sh echo ======= LogManageri start ========== #This directory is getting the raw data from remote server Raw_data=/opt/ftplogs # This directory is ready for process the data Processing_dir=/opt/processing_dir # This directory is prcoessed files and...

LEARN ABOUT SUSE

simpleftp

SIMPLEFTP(1)						    InterNetNews Documentation						      SIMPLEFTP(1)

NAME

       simpleftp - Rudimentary FTP client

SYNOPSIS

       simpleftp url [...]

DESCRIPTION

       simpleftp is a Perl script that provides basic support for fetching files with FTP in a batch oriented fashion.	It takes one or more FTP
       URLs on the command line.  The file(s) will be retrieved from the remote server and placed in the current directory with the same basename
       as on the remote; e.g., <ftp://ftp.isc.org/pub/usenet/CONFIG/active.gz> is stored as active.gz in the current directory.

       The script properly understands usernames, passwords and ports specified as follows:

	   ftp://user:password@host:port/path/file

BUGS

       simpleftp is an extremely poor substitute for more complete programs like the freely available wget or ncftp utilities.	It was written
       only to provide elementary support in INN for non-interactive fetching of the files in <ftp://ftp.isc.org/pub/pgpcontrol/> or
       <ftp://ftp.isc.org/pub/usenet/CONFIG/> without requiring administrators to install yet another package.	Its shortcomings as a general
       purpose program are too numerous to mention, but one that stands out is that downloaded files by simpleftp override existing files with the
       same name in the local directory.

HISTORY

       Tossed off by David C Lawrence <tale@isc.org> for InterNetNews.	Rewritten to use "Net::FTP" by Julien Elie.

       $Id: simpleftp.pod 8357 2009-02-27 17:56:00Z iulius $

SEE ALSO

       actsync(8).

INN 2.5.2							    2009-05-21							      SIMPLEFTP(1)