FTP run from shell script gives slow transfer rates Post: 302304914

Sponsored Content

Top Forums Shell Programming and Scripting FTP run from shell script gives slow transfer rates Post 302304914 by Countificus on Tuesday 7th of April 2009 02:42:42 PM

04-07-2009

Registered User

FTP run from shell script gives slow transfer rates

Hey everybody, this is my first post so be gentle. I have two Sun 5220's running Solaris 10 that are directly connected with a cross-over cable at Gig. One of these boxes is my production Oracle server which generates a 50GB dump file every evening at 10:50. The other Solaris is a devolopment server that is identical to the production. While they are attached to the network using IPMP and two of the NICs, I have 1 extra NIC dedicated to this private network between boxes. I am trying to script the FTP transfer between servers.

Here is the issue. When I run FTP interactively from Server A (prod) and do a put, I can transfer the file in 35 minutes or so. However when i run the same FTP commands in a shell script takes 5-7 hours to complete. I have thought maybe this is a priority issue and have looked at NICE, but I am kind of scared to mess with processor priority on my production database server.

Here is my script with then names changed to protect the innocent. I run this script from Server A (prod). It is pretty straight forward, so I really don't think their is a problem with the code. Something is causing it run 10 times slower when run from a script. Thanks in advance to anyone who can help me here.

#!/bin/sh
HOST="192.168.1.2"
USER="user"
PASSWD="passwd"

cd /u14/exp

ftp -in $HOST <<END_FTP
quote USER $USER
quote PASS $PASSWD
cd /u11/exp
put file.dmp
quit
END_FTP
EOF

Countificus

View Public Profile for Countificus

Find all posts by Countificus

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

script to be run after every FTP transfer

Hello everyone, we are running VSFtpd as FTP Server on Redhat AS 5. I would like to have a script to be run immediately after every FTP transfer. Is is possible (or with any other FTP Server?). I thought of writing a script to monitor if FTP transfer happening and run the required-script...

2. Shell Programming and Scripting

Script for FTP (transfer only new files)

Hi everybody, I just want to transfer files with FTP (mget and mput). The problem is that I dont want to overwrite any existing files and don't want to transfer them again (e.g. using the rename-function). So I only want to transfer new files with mget and mput. My first idea was to create...

3. Shell Programming and Scripting

RSYNC script to transfer folders recursively without overwriting via FTP

Hi all, I would need a bash script to sync/transfer folders recursively via FTP/RSYNC (I initially planned to use FTP but I heard RSYNC would fit a lot better for this job(?)) The situation: 3 different Linux servers 1. source 2. destination - Samba 3. Server where the script runs on ...

4. UNIX for Dummies Questions & Answers

Very SLOW STFTP transfer rate

Hi, I am experiencing extremely show transfer rates when transferring zip files over SFTP. Over FTP it works fine. I have disabled compression in the sshd_config file but that does not seem to help.. Any ideas?

5. Windows & DOS: Issues & Discussions

to run shell script using FTP

Hi All, From FTP prompt, How to run Unix Shell scripts? Thanks in Advance,

6. Shell Programming and Scripting

How to run a shell script on a remote host using ftp

Hi, is there a way I can run a shell script through ftp on a remote host? The remote host doesn't have ssh running so I can't use ssh.

7. Shell Programming and Scripting

Shell Scripting for creating ftp and transfer file

Dear All, We run backup script to update backup file every hour. I want to create a script, which transfer these files in another server using ftp as new backup file created every hour. Files should be stored with a unique name for every hour(e.g 20130708_13:00 , 20130708_14:00 and so on) and...

8. UNIX for Dummies Questions & Answers

To run ksh script via autosys job without asking password for file transfer

I've K shell script. It will transfer the files from one server to other server using 'SCP' command. While running the script alone as a command line in UNIX ssh terminal its running with out asking password and files are transferred with out asking for password. But by running the script using...

9. Shell Programming and Scripting

Shell script reading file slow

I have shell program as below #!/bin/sh echo ======= LogManageri start ========== #This directory is getting the raw data from remote server Raw_data=/opt/ftplogs # This directory is ready for process the data Processing_dir=/opt/processing_dir # This directory is prcoessed files and...

LEARN ABOUT X11R4

ftpconfig

ftpconfig(1M)						  System Administration Commands					     ftpconfig(1M)

NAME

       ftpconfig - set up anonymous FTP

SYNOPSIS

       ftpconfig [ftpdir]

       ftpconfig -d ftpdir

DESCRIPTION

       The ftpconfig script is executed by the super user to set up anonymous FTP. Anonymous FTP allows users to remotely log on to the FTP server
       by specifying the user name  ftp or anonymous and the user's email  address as password. The anonymous users  are  logged  on  to  the  FTP
       Server  and  given  access to a restricted file area with its own file system root. See chroot(2). The FTP area has  its own minimal system
       files.

       This command will copy and set up all the components needed to operate an anonymous FTP server, including creating the  ftp  user  account,
       creating  device  nodes,  copying  /usr/lib files, and copying timezone data.  The passwd and group files set up have been stripped down to
       prevent malicious users from finding login names on the server.	The anonymous file area will be placed	under  ftpdir.	If  the  ftp  user
       account already exists, then the current FTP area is used, and the system files in it are updated. All other files are left untouched. This
       command should be run to update the anonymous FTP area's configuration whenever a system patch is installed, or the system is upgraded.

OPTIONS

       -d	Create a new or update an existing ftpdir without creating or updating the ftp user account. Use this option when  creating  guest
		FTP user accounts.

OPERANDS

       The following operands are supported:

       ftpdir	The absolute pathname of the directory under which the anonymous FTP area is set up.

EXIT STATUS

       The following exit values are returned:

       0	Successful completion

       1	Improper usage of the command

       2	Command failed

ATTRIBUTES

       See attributes(5)  for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWftpu			   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Evolving			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       ftpaddhost(1M), in.ftpd(1M), useradd(1M), chroot(2), attributes(5)

SunOS 5.10							    1 May 2003							     ftpconfig(1M)