FTP run from shell script gives slow transfer rates Post: 302304969

Sponsored Content

Top Forums Shell Programming and Scripting FTP run from shell script gives slow transfer rates Post 302304969 by vgersh99 on Tuesday 7th of April 2009 04:33:14 PM

04-07-2009

Moderator

Quote:

Originally Posted by Countificus

When I run the script or run ftp manually, I have a PuTTY session open to the destination server and directory so that I can see the progress. From the script it takes approximately 6 minutes to transfer 1GB of data. When run interactively 1GB transfers in about 40 seconds.

Everything should be the same. FTP works from the script, it is just like it has been throttled. One more thing I thought of, our production server runs a script every 3 minutes during the first 10 days of the month that polls for ftp connections where data files are being submitted by our customers. I wonder if the previous admin (who did not docuemnt anything Smilie

) added something to the config which is throttling the bandwidth on non-interactive ftp connections?

Not sure if it's possible, but then again I have not done much with the ftpd myself.
One thing from 'man ftpd' (on Solaris) kinda caught my eye:

Code:

     -X    Write the output from the -i and  -o  options  to  the
           syslogd(1M)  file  instead  of xferlog(4). This allows
           the collection of output from  several  hosts  on  one
           central  loghost.  You  can  override  the  -X  option
           through use of the ftpaccess(4) file.

maybe there's an extensive logging going on with the '-i' option that you have in your script and don't have with the cli.

Quote:

Originally Posted by Countificus

What exactly does set-x do? I am pretty green, but I am catching on fast. I was a Windoze AD and Exchange admin for 10 years before I got this job and have been in the UNIX world for about 6 months.

'set -x' will output ALL the commends from the script as they're to be executed - this is a shell's debugging mechanism.

vgersh99

View Public Profile for vgersh99

Find all posts by vgersh99

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

script to be run after every FTP transfer

Hello everyone, we are running VSFtpd as FTP Server on Redhat AS 5. I would like to have a script to be run immediately after every FTP transfer. Is is possible (or with any other FTP Server?). I thought of writing a script to monitor if FTP transfer happening and run the required-script...

2. Shell Programming and Scripting

Script for FTP (transfer only new files)

Hi everybody, I just want to transfer files with FTP (mget and mput). The problem is that I dont want to overwrite any existing files and don't want to transfer them again (e.g. using the rename-function). So I only want to transfer new files with mget and mput. My first idea was to create...

3. Shell Programming and Scripting

RSYNC script to transfer folders recursively without overwriting via FTP

Hi all, I would need a bash script to sync/transfer folders recursively via FTP/RSYNC (I initially planned to use FTP but I heard RSYNC would fit a lot better for this job(?)) The situation: 3 different Linux servers 1. source 2. destination - Samba 3. Server where the script runs on ...

4. UNIX for Dummies Questions & Answers

Very SLOW STFTP transfer rate

Hi, I am experiencing extremely show transfer rates when transferring zip files over SFTP. Over FTP it works fine. I have disabled compression in the sshd_config file but that does not seem to help.. Any ideas?

5. Windows & DOS: Issues & Discussions

to run shell script using FTP

Hi All, From FTP prompt, How to run Unix Shell scripts? Thanks in Advance,

6. Shell Programming and Scripting

How to run a shell script on a remote host using ftp

Hi, is there a way I can run a shell script through ftp on a remote host? The remote host doesn't have ssh running so I can't use ssh.

7. Shell Programming and Scripting

Shell Scripting for creating ftp and transfer file

Dear All, We run backup script to update backup file every hour. I want to create a script, which transfer these files in another server using ftp as new backup file created every hour. Files should be stored with a unique name for every hour(e.g 20130708_13:00 , 20130708_14:00 and so on) and...

8. UNIX for Dummies Questions & Answers

To run ksh script via autosys job without asking password for file transfer

I've K shell script. It will transfer the files from one server to other server using 'SCP' command. While running the script alone as a command line in UNIX ssh terminal its running with out asking password and files are transferred with out asking for password. But by running the script using...

9. Shell Programming and Scripting

Shell script reading file slow

I have shell program as below #!/bin/sh echo ======= LogManageri start ========== #This directory is getting the raw data from remote server Raw_data=/opt/ftplogs # This directory is ready for process the data Processing_dir=/opt/processing_dir # This directory is prcoessed files and...

LEARN ABOUT MOJAVE

platform::shell

platform::shell(n)					       Tcl Bundled Packages						platform::shell(n)

__________________________________________________________________________________________________________________________________________________

NAME

       platform::shell - System identification support code and utilities

SYNOPSIS

       package require platform::shell ?1.1.4?

       platform::shell::generic shell
       platform::shell::identify shell
       platform::shell::platform shell
_________________________________________________________________

DESCRIPTION

       The platform::shell package provides several utility commands useful for the identification of the architecture of a specific Tcl shell.

       This  package  allows the identification of the architecture of a specific Tcl shell different from the shell running the package. The only
       requirement is that the other shell (identified by its path), is actually executable on the current machine.

       While for most platform this means that the architecture of the interrogated shell is identical to the architecture of  the  running  shell
       this  is  not generally true. A counter example are all platforms which have 32 and 64 bit variants and where a 64bit system is able to run
       32bit code. For these running and interrogated shell may have different 32/64 bit settings and thus different identifiers.

       For applications like a code repository it is important to identify the architecture of the shell which will  actually  run  the  installed
       packages, versus the architecture of the shell running the repository software.

COMMANDS

       platform::shell::identify shell
	      This command does the same identification as platform::identify, for the specified Tcl shell, in contrast to the running shell.

       platform::shell::generic shell
	      This command does the same identification as platform::generic, for the specified Tcl shell, in contrast to the running shell.

       platform::shell::platform shell
	      This command returns the contents of tcl_platform(platform) for the specified Tcl shell.

KEYWORDS

       operating system, cpu architecture, platform, architecture

platform::shell 						       1.1.4							platform::shell(n)