04-07-2009
When I run the script or run ftp manually, I have a PuTTY session open to the destination server and directory so that I can see the progress. From the script it takes approximately 6 minutes to transfer 1GB of data. When run interactively 1GB transfers in about 40 seconds.
Everything should be the same. FTP works from the script, it just behaves like it has been throttled. One more thing I thought of, our production server runs a script every 3 minutes during the first 10 days of the month that polls for ftp connections where data files are being submitted by our customers. I wonder if the previous admin (who did not document anything
) added something to the config which is throttling the bandwidth on non-interactive ftp connections?
What exactly does set-x do? I am pretty green, but I am catching on fast. I was a Windoze AD and Exchange admin for 10 years before I got this job and have been in the UNIX world for about 6 months.
Last edited by Countificus; 04-07-2009 at 05:31 PM..
9 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
Hello everyone,
we are running VSFtpd as FTP Server on Redhat AS 5. I would like to have a script to be run immediately after every FTP transfer. Is is possible (or with any other FTP Server?).
I thought of writing a script to monitor if FTP transfer happening and run the required-script... (2 Replies)
Discussion started by: prvnrk
2 Replies
2. Shell Programming and Scripting
Hi everybody,
I just want to transfer files with FTP (mget and mput). The problem is that I dont want to overwrite any existing files and don't want to transfer them again (e.g. using the rename-function). So I only want to transfer new files with mget and mput.
My first idea was to create... (3 Replies)
Discussion started by: inoxx
3 Replies
3. Shell Programming and Scripting
Hi all,
I would need a bash script to sync/transfer folders recursively via FTP/RSYNC
(I initially planned to use FTP but I heard RSYNC would fit a lot better for this job(?))
The situation:
3 different Linux servers
1. source
2. destination - Samba
3. Server where the script runs on
... (2 Replies)
Discussion started by: thibautp
2 Replies
4. UNIX for Dummies Questions & Answers
Hi,
I am experiencing extremely show transfer rates when transferring zip files over SFTP. Over FTP it works fine.
I have disabled compression in the sshd_config file but that does not seem to help..
Any ideas? (0 Replies)
Discussion started by: mojoman
0 Replies
5. Windows & DOS: Issues & Discussions
Hi All,
From FTP prompt, How to run Unix Shell scripts?
Thanks in Advance, (1 Reply)
Discussion started by: HemaV
1 Replies
6. Shell Programming and Scripting
Hi,
is there a way I can run a shell script through ftp on a remote host? The remote host doesn't have ssh running so I can't use ssh. (7 Replies)
Discussion started by: mrskittles99
7 Replies
7. Shell Programming and Scripting
Dear All,
We run backup script to update backup file every hour.
I want to create a script, which transfer these files in another server using ftp as new backup file created every hour. Files should be stored with a unique name for every hour(e.g 20130708_13:00 , 20130708_14:00 and so on) and... (13 Replies)
Discussion started by: Preeti Saini
13 Replies
8. UNIX for Dummies Questions & Answers
I've K shell script. It will transfer the files from one server to other server using 'SCP' command. While running the script alone as a command line in UNIX ssh terminal its running with out asking password and files are transferred with out asking for password. But by running the script using... (6 Replies)
Discussion started by: maheshbabu
6 Replies
9. Shell Programming and Scripting
I have shell program as below
#!/bin/sh
echo ======= LogManageri start ==========
#This directory is getting the raw data from remote server
Raw_data=/opt/ftplogs
# This directory is ready for process the data
Processing_dir=/opt/processing_dir
# This directory is prcoessed files and... (4 Replies)
Discussion started by: Chenchireddy
4 Replies
LEARN ABOUT REDHAT
ncftpls
ncftpls(1) General Commands Manual ncftpls(1)
NAME
ncftpls - Internet file transfer program for scripts
SYNOPSIS
ncftpls [options] ftp://url.style/host/path/name/
OPTIONS
Command line flags:
-1 Most basic format, one item per line.
-l Long list format.
-R Long list format, recurse subdirectories. Equivalent to "-x -lR".
-x -XX Additional ls flags to pass on to the server.
-u XX Use username XX instead of anonymous.
-p XX Use password XX with the username.
-P XX Use port number XX instead of the default FTP service port (21).
-d XX Use the file XX for debug logging.
-t XX Timeout after XX seconds.
-E Use regular (PORT) data connections.
-F Use passive (PASV) data connections. The default is to use passive, but to fallback to regular if the passive connection fails or
times out.
-r XX Redial a maximum of XX times until connected to the remote FTP server.
-W XX Send raw FTP command XX after logging in.
-X XX Send raw FTP command XX after each file transferred.
-Y XX Send raw FTP command XX before logging out.
The -W, -X, and -Y options are useful for advanced users who need to tweak behavior on some servers. For example, users accessing
mainframes might need to send some special SITE commands to set blocksize and record format information.
For these options, you can use them multiple times each if you need to send multiple commands. For the -X option, you can use the
cookie %s to expand into the name of the file that was transferred.
DESCRIPTION
The purpose of ncftpls is to do remote directory listings using the File Transfer Protocol without entering an interactive shell. This
lets you write shell scripts or other unattended processes that can do FTP.
The default behavior is to print the directory listing in columnized format (i.e. ls -CF), but that is not very useful for scripting. This
example uses the -1 flag, to print one file per line:
$ ncftpls -1 ftp://ftp.ncftp.com/pub/ncftp/
You can also do a remote "ls -l", by using "ncftpls -l". If you want to try other flags, you have to use them with the -x flag. For exam-
ple, if you wanted to do a remote "ls -lrt", you could do this:
$ ncftpls -x "-lrt" ftp://ftp.ncftp.com/pub/ncftp/
By default the program tries to open the remote host and login anonymously, but you can specify a username and password information like
you can with ncftpget or ncftpput.
DIAGNOSTICS
ncftpls returns the following exit values:
0 Success.
1 Could not connect to remote host.
2 Could not connect to remote host - timed out.
3 Transfer failed.
4 Transfer failed - timed out.
5 Directory change failed.
6 Directory change failed - timed out.
7 Malformed URL.
8 Usage error.
9 Error in login configuration file.
10 Library initialization failed.
11 Session initialization failed.
AUTHOR
Mike Gleason, NcFTP Software (mgleason@ncftp.com).
SEE ALSO
ncftpput(1), ncftpget(1), ncftp(1), ftp(1), rcp(1), tftp(1).
LibNcFTP (http://www.ncftp.com/libncftp/).
Software NcFTP ncftpls(1)