ftp multiple files at the same time Post: 302551990

Sponsored Content

Top Forums Shell Programming and Scripting ftp multiple files at the same time Post 302551990 by drl on Thursday 1st of September 2011 09:52:48 AM

09-01-2011

Registered User

Hi.
I agree with previous suggestions for combining the files, and then sending a single file.

However, if you don't wish to do that, then for one alternate solution, see GNU Parallel - GNU Project - Free Software Foundation :

Code:

       GNU parallel is a shell tool for executing jobs in parallel using one
       or more computers. A job is can be a single command or a small script
       that has to be run for each of the lines in the input. The typical
       input is a list of files, a list of hosts, a list of users, a list of
       URLs, or a list of tables. A job can also be a command that reads from
       a pipe. GNU parallel can then split the input and pipe it into commands
       in parallel.

       If you use xargs and tee today you will find GNU parallel very easy to
       use as GNU parallel is written to have the same options as xargs. If
       you write loops in shell, you will find GNU parallel may be able to
       replace most of the loops and make them run faster by running several
       jobs in parallel.

another is Parallel Distributed Shell | Download Parallel Distributed Shell software for free at SourceForge.net :

Code:

       pdsh is a variant of the rsh(1) command. Unlike rsh(1), which runs
       commands on a single remote host, pdsh can run multiple remote commands
       in parallel. pdsh uses a "sliding window" (or fanout) of threads to
       conserve resources on the initiating host while allowing some
       connections to time out.

Best wishes ... cheers, drl

drl

View Public Profile for drl

Find all posts by drl

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need to send multiple files during ftp

Hi guys... I'm working on #!/bin/sh script in a Solaris 7 box that should send several files over to another machine via FTP. Here's what the script looks like: # This script will send the daily MSP customer counts # to the Crystal Reports server located at 192.168.2.106 cd...

2. HP-UX

how to ftp multiple files

Hi, I have to write a ftp script which transfers multiple files from one unix server to another. When I try to transfer single file it goes through successfully. But, When I try to do multiple files none of the files get ftp'd. And also, even the single file goes transferred successfully, I...

3. IP Networking

Automated ftp for Multiple files

I have seen the script posted yesterday for automated ftp Can we do some thing like ftp ing multiple files in one script Example input.txt has all files names to be ftped input.txt ------ a.tar b.ccp c.perl i need to ftp all the files present in input.txt i tried something like...

4. Shell Programming and Scripting

Help in FTP'ing multiple files

Hi, I have written the following FTP script to get the multiple files from remote server to local server. My problem is that 'mget *' is not working in the script. I also tried with 'mget *.txt', 'mget *.*' etc. without any success. It do not copy any file to local server. In the script, Prompt...

5. Shell Programming and Scripting

Same time ftp download in perl multiple sites.

I currently have a perl script that have to retreive a single file from 20+ sites every 10 min. Right now it will ftp to site1 and download and continue up until site20. I am trying to get this to run all the ftp d/l at the same time. This is where I have my problem, I can't get it to work. ...

6. Shell Programming and Scripting

ftp multiple files from same directory

Hi there Gurus, I have the following ftp script: $ more ftp_dump_arch4.sh #! /usr/bin/ksh # Constant variables HOST='xx.xx.xx.xx' USER='user' PASSWD='password' dir='/export/file' ftp_log='/tmp' ftp -n $HOST > $ftp_log/ftp.log << END user $USER $PASSWD verbose lcd $dir bin

7. Shell Programming and Scripting

To remove multiple files in FTP

We have a files in FTP server..... after getting the files from FTP by mget *.* i hav to remove all files (multiple files) at once... is there any command to delete multiple files at once

8. Shell Programming and Scripting

FTP multiple files from multiple directories

I have multiple files that starts as TRADE_LOG spread across multiple folders in the given structure.. ./dir1/1/TRADE_LOG*.gz ./dir2/10/TRADE_LOG*.gz ./dir11/12/TRADE_LOG*.gz ./dir12/13/TRADE_LOG*.gz when I do ftp uisng mput from the "." dir I am getting the below given error mput...

9. Shell Programming and Scripting

Transfer multiple different files in FTP

Hi All, i am doing ftp how can i transfer multiple different files example- 03-21-13 06:33AM 46800 CATT_HOURS.pgp 03-21-13 06:33AM 266392 CATT_TAX.txt 03-21-13 06:33AM 91448 CATT_STATUS.txt 03-21-13 06:33AM 468 ...

10. Shell Programming and Scripting

Ftp multiple files one at a time

Hi, I have a problem while ftp'ing zip files one after the other from linux source directory to a ftp host machine. here is the shell script: #!/bin/ksh dir=data/dir1/dir2 # this dir is linux source directory where zip files located. rmtdir='/home/' echo $dir for i in /$dir/*; do if ;...

LEARN ABOUT SUNOS

proofserv

PROOFSERV(1)						      General Commands Manual						      PROOFSERV(1)

NAME

       proofserv - PROOF (The Parallel ROOT Facility)

DESCRIPTION

       Using  PROOF  (The  Parallel  ROOT  Facility) one can analyze trees in parallel on a cluster of computers. The PROOF system consists of the
       proofd(1) from-end program which is started via inetd(8).

       proofd takes care of user authentication and overlays itself then with the desired version of the proofserv(1) executable.

       The proofserv(1) is a basically the same as the ROOT interactive module root(1), except that it reads its commands from a socket instead of
       from the terminal.

       Since it is a remote server it will not do graphics and therefore is not linked with any graphics libraries (Motif, X11, etc.).

       proofserv is started by the daemon proofd(1) on request by the user.  It is not a command to be executed by the user directly.

       Note, that if proofserv is passed any arguments, it will use the libProofx interface, rather than the standard libProof interface.

SEE ALSO

       proofd(1) , root(1) , rootd(1)

       More information can be found at the ROOT website: http://root.cern.ch <http://root.cern.ch>

ORIGINAL AUTHORS

       The ROOT team (see web page above):
	      Rene Brun and Fons Rademakers

COPYRIGHT

       This  library  is  free software; you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as pub-
       lished by the Free Software Foundation; either version 2.1 of the License, or (at your option) any later version.

       This library is distributed in the hope that it will be useful, but WITHOUT ANY	WARRANTY;  without  even  the  implied	warranty  of  MER-
       CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU Lesser General Public License for more details.

       You  should have received a copy of the GNU Lesser General Public License along with this library; if not, write to the Free Software Foun-
       dation, Inc., 51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA

AUTHOR

       This manual page was written by Christian Holm Christensen <cholm@nbi.dk>, for the Debian GNU/Linux system (but may be used by others).

ROOT
								     Version 3							      PROOFSERV(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need to send multiple files during ftp

Discussion started by: cdunavent

2. HP-UX

how to ftp multiple files

Discussion started by: isingh786

3. IP Networking

Automated ftp for Multiple files

Discussion started by: pbsrinivas

4. Shell Programming and Scripting

Help in FTP'ing multiple files

Discussion started by: berlin_germany