ftp multiple files at the same time


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting ftp multiple files at the same time
# 8  
Old 09-01-2011
This'd be much easier in anything but c-shell.
# 9  
Old 09-01-2011
Hi.
I agree with previous suggestions for combining the files, and then sending a single file.

However, if you don't wish to do that, then for one alternate solution, see GNU Parallel - GNU Project - Free Software Foundation :
Code:
       GNU parallel is a shell tool for executing jobs in parallel using one
       or more computers. A job is can be a single command or a small script
       that has to be run for each of the lines in the input. The typical
       input is a list of files, a list of hosts, a list of users, a list of
       URLs, or a list of tables. A job can also be a command that reads from
       a pipe. GNU parallel can then split the input and pipe it into commands
       in parallel.

       If you use xargs and tee today you will find GNU parallel very easy to
       use as GNU parallel is written to have the same options as xargs. If
       you write loops in shell, you will find GNU parallel may be able to
       replace most of the loops and make them run faster by running several
       jobs in parallel.

another is Parallel Distributed Shell | Download Parallel Distributed Shell software for free at SourceForge.net :
Code:
       pdsh is a variant of the rsh(1) command. Unlike rsh(1), which runs
       commands on a single remote host, pdsh can run multiple remote commands
       in parallel. pdsh uses a "sliding window" (or fanout) of threads to
       conserve resources on the initiating host while allowing some
       connections to time out.


Best wishes ... cheers, drl
# 10  
Old 09-03-2011
Hi CRL,

Thanks for your reply. I have actually knew both the programs, but they will open a new connection for every instance of the ncftp. I am actually looking for some solution in Unix like filezilla works on windows i.e. upload multiple files with a single connection. Please see if you can find something.

Regards
# 11  
Old 09-03-2011
You can download a binary (or compile it yourself).
But I don't think FileZilla supports multithreaded operations (lftp seems to support parallel put/get though).
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Ftp multiple files one at a time

Hi, I have a problem while ftp'ing zip files one after the other from linux source directory to a ftp host machine. here is the shell script: #!/bin/ksh dir=data/dir1/dir2 # this dir is linux source directory where zip files located. rmtdir='/home/' echo $dir for i in /$dir/*; do if ;... (7 Replies)
Discussion started by: raj78
7 Replies

2. Shell Programming and Scripting

Transfer multiple different files in FTP

Hi All, i am doing ftp how can i transfer multiple different files example- 03-21-13 06:33AM 46800 CATT_HOURS.pgp 03-21-13 06:33AM 266392 CATT_TAX.txt 03-21-13 06:33AM 91448 CATT_STATUS.txt 03-21-13 06:33AM 468 ... (3 Replies)
Discussion started by: krupasindhu18
3 Replies

3. Shell Programming and Scripting

FTP multiple files from multiple directories

I have multiple files that starts as TRADE_LOG spread across multiple folders in the given structure.. ./dir1/1/TRADE_LOG*.gz ./dir2/10/TRADE_LOG*.gz ./dir11/12/TRADE_LOG*.gz ./dir12/13/TRADE_LOG*.gz when I do ftp uisng mput from the "." dir I am getting the below given error mput... (1 Reply)
Discussion started by: prasperl
1 Replies

4. Shell Programming and Scripting

To remove multiple files in FTP

We have a files in FTP server..... after getting the files from FTP by mget *.* i hav to remove all files (multiple files) at once... is there any command to delete multiple files at once (2 Replies)
Discussion started by: nani1984
2 Replies

5. Shell Programming and Scripting

ftp multiple files from same directory

Hi there Gurus, I have the following ftp script: $ more ftp_dump_arch4.sh #! /usr/bin/ksh # Constant variables HOST='xx.xx.xx.xx' USER='user' PASSWD='password' dir='/export/file' ftp_log='/tmp' ftp -n $HOST > $ftp_log/ftp.log << END user $USER $PASSWD verbose lcd $dir bin (3 Replies)
Discussion started by: lweegp
3 Replies

6. Shell Programming and Scripting

Same time ftp download in perl multiple sites.

I currently have a perl script that have to retreive a single file from 20+ sites every 10 min. Right now it will ftp to site1 and download and continue up until site20. I am trying to get this to run all the ftp d/l at the same time. This is where I have my problem, I can't get it to work. ... (5 Replies)
Discussion started by: kofs79
5 Replies

7. Shell Programming and Scripting

Help in FTP'ing multiple files

Hi, I have written the following FTP script to get the multiple files from remote server to local server. My problem is that 'mget *' is not working in the script. I also tried with 'mget *.txt', 'mget *.*' etc. without any success. It do not copy any file to local server. In the script, Prompt... (10 Replies)
Discussion started by: berlin_germany
10 Replies

8. IP Networking

Automated ftp for Multiple files

I have seen the script posted yesterday for automated ftp Can we do some thing like ftp ing multiple files in one script Example input.txt has all files names to be ftped input.txt ------ a.tar b.ccp c.perl i need to ftp all the files present in input.txt i tried something like... (0 Replies)
Discussion started by: pbsrinivas
0 Replies

9. HP-UX

how to ftp multiple files

Hi, I have to write a ftp script which transfers multiple files from one unix server to another. When I try to transfer single file it goes through successfully. But, When I try to do multiple files none of the files get ftp'd. And also, even the single file goes transferred successfully, I... (4 Replies)
Discussion started by: isingh786
4 Replies

10. Shell Programming and Scripting

Need to send multiple files during ftp

Hi guys... I'm working on #!/bin/sh script in a Solaris 7 box that should send several files over to another machine via FTP. Here's what the script looks like: # This script will send the daily MSP customer counts # to the Crystal Reports server located at 192.168.2.106 cd... (2 Replies)
Discussion started by: cdunavent
2 Replies
Login or Register to Ask a Question