Crontab Wget, downloading a file to a FTP


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Crontab Wget, downloading a file to a FTP
# 8  
Old 11-03-2010
Maybe you need to use the absolute path in the URL. A good URL should work in a browser to show you that dir.
# 9  
Old 11-03-2010
Quote:
Originally Posted by DGPickett
Maybe you need to use the absolute path in the URL. A good URL should work in a browser to show you that dir.
I'm not sure what do you mean Smilie
# 10  
Old 11-03-2010
ftp://id:pw@host/home/user/public_html/folder/ not ftp://id:pw@host/public_html/folder/

URLs are usually absolute to the machine, not relative to the id, but it varies by setup and ftp daemon. Some make the ftp login world look like chroot $HOME so you cannot wander. Try the extended URL in a browser first, to ensure it is valid.
# 11  
Old 11-03-2010
Quote:
Originally Posted by DGPickett
ftp://idSmiliew@host/home/user/public_html/folder/ not ftp://idSmiliew@host/public_html/folder/

URLs are usually absolute to the machine, not relative to the id, but it varies by setup and ftp daemon. Some make the ftp login world look like chroot $HOME so you cannot wander. Try the extended URL in a browser first, to ensure it is valid.
I tried that too, and this is the log:

Code:
--22:11:01--  http://www.somesite.com/webcam32.jpg
           => `webcam32.jpg.173'
Resolving www.somesite.com... xxx.xxx.xxx.149 Connecting to www.somesite.com|195.173.130.149|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 21,547 (21K) [image/jpeg]

    0K .......... .......... .                               100%  192.17 KB/s

22:11:01 (192.17 KB/s) - `webcam32.jpg.173' saved [21547/21547]

--22:11:01--  ftp://user:*password*@ftp.myserver.net/home/user/public_html/yyy/
           => `.listing'
Resolving ftp.myserver.net... xxx.xxx.xxx.71 Connecting to ftp.myserver.net|xxx.xxx.xxx.71|:21... connected.
Logging in as UserName ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD /home/user/public_html/yyy ... 
No such directory `home/user/public_html/yyy'.

unlink: No such file or directory

FINISHED --22:11:01--
Downloaded: 21,547 bytes in 1 files

Files are still being saved to the very first root folder :/

The above is using the main ftp user.

I also tried creating an ftp account, which only has access to a particular folder on my ftp server. Still, files were saved to the root folder...

edit:

This command seems to be doing something according to the email below
Code:
ftp://user:*password*@ftp.myserver.net/public_html/yyy/

Code:
--23:10:01--  http://www.somesite.com/webcam32.jpg
           => `webcam32.jpg.31'
Resolving www.somesite.com... 195.173.130.149 Connecting to www.somesite.com|xxx.xxx.xxx.149|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 22,550 (22K) [image/jpeg]

    0K .......... .......... ..                              100%  202.63 KB/s

23:10:01 (202.63 KB/s) - `webcam32.jpg.31' saved [22550/22550]

--23:10:01--  ftp://user:*password*@ftp.myserver.net/public_html/yyy/
           => `.listing'
Resolving ftp.myserver.net... xxx.xxx.xxx.71 Connecting to ftp.myserver.net|xxx.xxx.xxx.71|:21... connected.
Logging in as user ... Logged in!
==> SYST ... done.    ==> PWD ... done.
==> TYPE I ... done.  ==> CWD /public_html/yyy ... done.
==> PASV ... done.    ==> LIST ... done.

    0K .......... .......... .......... .......... ..........    1.82 MB/s
   50K .......... .......... ..........                        112.09 MB/s

23:10:01 (2.88 MB/s) - `.listing' saved [81993]

Removed `.listing'.
Wrote HTML-ized index to `index.html.6' [176981].

FINISHED --23:10:01--
Downloaded: 22,550 bytes in 1 files

Unfortunately, files are still being saved to the root folder :[

Last edited by zYx; 11-03-2010 at 07:12 PM..
# 12  
Old 11-03-2010
Well, I am a bit short on documentation for your 'get'. Does the URL work in IE or Firefox?
# 13  
Old 11-03-2010
Quote:
Originally Posted by DGPickett
Well, I am a bit short on documentation for your 'get'. Does the URL work in IE or Firefox?
Yes it does.
# 14  
Old 11-03-2010
Maybe you have to wget it to a temp dir and then wput it, or wget|wput with stdout/stdin options. (It might be faster with the pipe, too!) What is your O/S?
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Wget for downloading a public file (stream) as mp4

I need a hint for using wget for getting a free content from a TV station that is streaming its material for a while until it appears on any video platform, that means no use of illegal methods, because it is on air, recently published and available. But reading the manual for wget I tried the... (5 Replies)
Discussion started by: 1in10
5 Replies

2. Shell Programming and Scripting

Wget error while downloading from https website

Hi, I would like to download a file from a https website. I don't have the file name as it changes every day. I am using the following command: wget --no-check-certificate -r -np --user=ABC --password=DEF -O temp.txt https://<website/directory> I am getting followin error in my... (9 Replies)
Discussion started by: pinnacle
9 Replies

3. Shell Programming and Scripting

Downloading FTP Files

Hi every one, I have the requirement to download the files from FTP and move those files to unix box. Once after coping the files, i need to remove the files in FTP. I'm a newbie in Unix script. Can you please suggest a script for this.. Thanks in advance.. (2 Replies)
Discussion started by: Murali4u
2 Replies

4. Shell Programming and Scripting

Downloading with Wget

Hello everyone. I'm new both to the forum and to unix scripting, and this website has been very useful in putting together a script I am working on. However, I have run into a bit of a snag, which is why I have come here seeking help. First I will say what I am trying to do, and then what I have... (2 Replies)
Discussion started by: keltonhalbert
2 Replies

5. UNIX for Dummies Questions & Answers

wget pdf downloading problem

Hi. I am trying to make a mirror of this free online journal: http://www.informaworld.com/smpp/title~content=t716100758~db=all Under the individual issues, the link location for the "Full Text PDF" does not have ".pdf" as an extension -- so when I use wget it misses the file. However clicking... (5 Replies)
Discussion started by: obo1234
5 Replies

6. Solaris

HTTP error while downloading solaris patches using wget

Hello, I am getting a HTTP error while downloading solaris patches using wget. 'Downloading unsigned patch 113096-03. --2010-06-18 03:51:15-- http://sunsolve.sun.com/pdownload.pl?target=113096-03&method=h Resolving sunsolve.sun.com (sunsolve.sun.com)... 192.18.108.40 Connecting to... (5 Replies)
Discussion started by: sunny_a_j
5 Replies

7. Shell Programming and Scripting

Problem in Downloading one day old files from FTP site

HI, I'm downloading one day old files from ftp site. Below is my script ---------------------------- printf "open $HOST \n" > ftp.cmd printf "user $USER $PASSWD\n" >> ftp.cmd printf "bin\n" >> ftp.cmd #printf "cd /Models/\n" >> ftp.cmd printf "prompt\n" >> ftp.cmd printf "for oldfile... (4 Replies)
Discussion started by: shekhar_v4
4 Replies

8. UNIX for Advanced & Expert Users

downloading through ftp

i have been busy getting accustomed to ssh and ftp and have a remote account that I am trying to comprehend.. my question is when I use ftp, ssh and remote accounts where do I download packages to.. which directory.. i have a cooledit package that is tarred and gziped which I ncftpd from... (6 Replies)
Discussion started by: moxxx68
6 Replies

9. UNIX for Dummies Questions & Answers

Downloading whole directory with FTP

Is it possible using FTP to download a whole directory and all subdirectories at once without having to go through every single file? Thanks, Tom (4 Replies)
Discussion started by: Pokeyzx
4 Replies

10. UNIX for Dummies Questions & Answers

downloading folders in ftp

can you download folders when in ftp or is the only way to download more then one file by mget?? (6 Replies)
Discussion started by: eloquent99
6 Replies
Login or Register to Ask a Question