Visit Our UNIX and Linux User Community


Recursive FTP -- here at last.


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Recursive FTP -- here at last.
# 8  
Old 11-25-2002
do recursively download stuff why dont you use wget? ('wget -r <url>')
# 9  
Old 11-25-2002
Quote:
Originally posted by The Fridgerator
do recursively download stuff why dont you use wget? ('wget -r <url>')
Because I had never heard of wget. Smilie

Oh well, c'est la vie. Here are some docs on wget.
# 10  
Old 09-19-2003
Fantastic effort Perderabo

Correct me if I'm wrong, isn't it a lot similar to rsync.?
# 11  
Old 09-19-2003
Remember the title of the thread...recursive ftp, not recursive copy. I wrote the first version of this when I was asked to sync a unix ftp server with an NT ftp server through two firewalls. That's quite a bit more than rsync can handle.

rsync depends on the berkeley remote shell command. That protocol is very insecure, perhaps the most insecure in existence. It always was unix specific and not that many unix shops still use it due to security. And I never seen a firewall configured to pass that protocol.

My script depends on the ftp protocol. Ftp won't win any awards for security either, but it does at least demand a password. Ftp is also widely available and I specificly included NT support.
# 12  
Old 09-20-2003
Quote:
Originally posted by Perderabo
rsync depends on the berkeley remote shell command. That protocol is very insecure, perhaps the most insecure in existence. It always was unix specific and not that many unix shops still use it due to security. And I never seen a firewall configured to pass that protocol.
This is I never knew - thanks for the lesson. Smilie
# 13  
Old 12-16-2003
# 14  
Old 02-08-2004
Howdy,

Nice script. I understand the overall flow of it, but not knowing all about the code I need some clarification.

What I need to know is how do you check that the path/destination exists? Which piece of code does this? I'm writing a similar script, however not quite as elaborate as this one, but this is a check that I'd like to do.

Any explanation would be greatly appreciated.

Cheers,
Linden

Previous Thread | Next Thread
Test Your Knowledge in Computers #167
Difficulty: Easy
The Transmission Control Protocol (TCP) is one of the least used protocols of the Internet protocol suite.
True or False?

10 More Discussions You Might Find Interesting

1. OS X (Apple)

Search recursive

before posting, I have tried to find my answer elsewhere. no luck. I need to find a file buried in a folder somewhere. Master folder has 10 sub folders. each sub folder has folders too. I found this but it does nothing I am on Mac and use Applescript. do shell script "find... (2 Replies)
Discussion started by: sbrady
2 Replies

2. UNIX for Dummies Questions & Answers

recursive search and ftp

Could someone help me in recursive search and ftp'ing the files to remote server? The host machine will have /dir1/dira/list_of_files1 /dir1/dirb/list_of_files2 /dir1/dirc/list_of_files3 . . . so., I need to search from dir1 recursively (only one level down) and find all the files that... (1 Reply)
Discussion started by: brahmi
1 Replies

3. UNIX for Dummies Questions & Answers

Recursive Permissions???

Is there anyway that I can change permissions on a directory and all its sub-directories and files using one single "chmod" command?? (5 Replies)
Discussion started by: the_red_dove
5 Replies

4. UNIX for Dummies Questions & Answers

recursive wc on a directory?

Hi all, I need to count the number of lines in all the files under a directory (several levels deep). I am feeling extremely dumb, but I don't know how to do that. Needless to say, I am not a shell script wiz... Any advice? thanks in advance! (13 Replies)
Discussion started by: bimba17
13 Replies

5. Cybersecurity

Recursive SFTP

Hello, I need to transfer files from Serve1 to Server2. Previously I was using scp command. Now I have to use sftp (due to audit issues). The problem with sftp is (atleast to my level of knowledge) we cannot transfer dirs (and files within that dir). Is there a way to solve this? Looks like... (1 Reply)
Discussion started by: MohanTJ
1 Replies

6. UNIX for Advanced & Expert Users

recursive sorting

In the ls command, -t option and -R option dont work simultaneously. ls -t ---> lists the files with sorting based on file date ls -R ---> lists the files recursively. How to make utilize both in the same command.? I want to sort the recursive files listing.. (1 Reply)
Discussion started by: fermisoft
1 Replies

7. Shell Programming and Scripting

recursive rcp

I wrote a shell script (AIX) to extract the file "/rep1/toto" from all the hosts referred in a list and send them to one local directory named ~/$host-$file with the hostname as prefix rcp -p user@host:/rep1/$file ~/$host-$file where file = toto ==> it works ! I would do the same thing... (6 Replies)
Discussion started by: Nicol
6 Replies

8. Shell Programming and Scripting

perl + Net::FTP::Recursive

Problem: It will not advance to the next user in the list. It always dies right after it sends the 2/2 files from the first users dir. $USERLIST="/export/home/mxdooley/perl_ftp/userlist"; $USER_DIR="/export/home/mxdooley/perl_ftp/homes";... (2 Replies)
Discussion started by: Optimus_P
2 Replies

9. UNIX for Dummies Questions & Answers

recursive effect!!

I run the following command in some of my folders... and ended up with a huge mess!! find . -type f -exec perl -e 's/blabla/zzzxxxx/gi' -p -i.bak {} \; I had to kill the process and later when I checked with one of my folders.. ls vaditerm.dt.bak vaditerm.dt.bak.bak... (2 Replies)
Discussion started by: sskb
2 Replies

10. UNIX for Dummies Questions & Answers

Recursive FTP

I am trying to write a recursive FTP script and have come to a point where I need to test if the file is either a normal ascii file or a directory. My question is how do I test if the file is either ascii or directory. (1 Reply)
Discussion started by: aslamg
1 Replies

Featured Tech Videos