downlading using wget fails


 
Thread Tools Search this Thread
Operating Systems Linux downlading using wget fails
# 8  
Old 04-03-2011
Yes, I can ping the host and also nslookup resolves the host address...
# 9  
Old 04-03-2011
but wget can't do it... you have to look at this more closely.
GNU Wget Manual - Startup File
maybe the settinds in ".wgetrc" are faulty...
# 10  
Old 04-03-2011
Another clue is:

Code:
-------------
$ nslookup repo2.maven.org
Server:		192.168.2.1
Address:	192.168.2.1#53

Non-authoritative answer:
Name:	repo2.maven.org
Address: 207.223.240.88
-----------
$ wget http://207.223.240.88/maven2/org/apa...-2.0.0-rc2.jar
--2011-04-03 12:06:51--  http://207.223.240.88/maven2/org/apa...-2.0.0-rc2.jar
Connecting to 207.223.240.88:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
2011-04-03 12:06:52 ERROR 403: Forbidden.
------------

I think there's a problem with my wget's host resolution... But also there's another problem as seen above: When I try downloading with the resolved ip, it gives forbidden error
# 11  
Old 04-03-2011
Hi,

I know this answer is similar to my last one, but here I paste the commands in my system. It works in the last example so I can't figure your problem.
Code:
$ wget http://207.223.240.88/maven2/org/apa...-2.0.0-rc2.jar
--2011-04-03 12:22:57--  http://207.223.240.88/maven2/org/apa...-2.0.0-rc2.jar
Connecting to 207.223.240.88:80... conectado.
Petición HTTP enviada, esperando respuesta... 403 Forbidden
2011-04-03 12:22:58 ERROR 403: Forbidden.
$ wget http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
--2011-04-03 12:23:57--  http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
Resolviendo repo2.maven.org... 207.223.240.88
Connecting to repo2.maven.org|207.223.240.88|:80... conectado.
Petición HTTP enviada, esperando respuesta... 403 Forbidden
2011-04-03 12:23:58 ERROR 403: Forbidden.
$ wget --user-agent="" http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
--2011-04-03 12:25:12--  http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.0.0-rc2/ivy-2.0.0-rc2.jar
Resolviendo repo2.maven.org... 207.223.240.88
Connecting to repo2.maven.org|207.223.240.88|:80... conectado.
Petición HTTP enviada, esperando respuesta... 200 OK
Longitud: 893199 (872K) [application/java-archive]
Saving to: `ivy-2.0.0-rc2.jar'

100%[============================================================>] 893.199      265K/s   in 3,8s    

2011-04-03 12:25:16 (229 KB/s) - `ivy-2.0.0-rc2.jar' saved [893199/893199]

Regards,
Birei

Last edited by birei; 04-03-2011 at 07:52 AM..
# 12  
Old 04-03-2011
Yes, with the --user-agent="" and host name to ip conversion, it works for me too.
But it still fails with the host name...
# 13  
Old 04-04-2011
Somehow your wget is using different DNS settings than the rest of your system. Have you checked your wgetrc files as requested?
# 14  
Old 04-04-2011
i was just to tired to ask this, again...
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

2. Shell Programming and Scripting

Wget and gz

Can wget be used to goto a site and piped into a .gz extrated command? wget ftp://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh37 | gunzip -d clinvar_20150603.vcf.gz (1 Reply)
Discussion started by: cmccabe
1 Replies

3. UNIX for Dummies Questions & Answers

Wget help

How can I download only *.zip and *.rar files from a website <index> who has multiple directories in root parent directory? I need wget to crawl every directory and download only zip and rar files. Is there anyway I could do it? (7 Replies)
Discussion started by: galford
7 Replies

4. Shell Programming and Scripting

Wget fails for a valid URL

Wget Error Codes: 0 No problems occurred. 1 Generic error code. 2 Parse error—for instance, when parsing command-line options, the .wgetrc or .netrc… 3 File I/O error. 4 Network failure. 5 SSL verification failure. 6 Username/password authentication failure. ... (3 Replies)
Discussion started by: mohtashims
3 Replies

5. Red Hat

Wget

If I run the following command wget -r --no-parent --reject "index.html*" 10.11.12.13/backups/ A local directory named 10.11.12.13/backups with the content of web site data is created. What I want to do is have the data placed in a local directory called $HOME/backups. Thanks for... (1 Reply)
Discussion started by: popeye
1 Replies

6. Shell Programming and Scripting

WGET help!

Hi Friends, I have an url like this https://www.unix.com/help/ In this help directory, I have more than 300 directories which contains file or files. So, the 300 directories are like this http://unix.com/help/ dir1 file1 dir2 file2 dir3 file3_1 file3_2... (4 Replies)
Discussion started by: jacobs.smith
4 Replies

7. UNIX for Dummies Questions & Answers

Wget

...... (1 Reply)
Discussion started by: hoo
1 Replies

8. Shell Programming and Scripting

wget help?

can someone please help in understanding this shell script? wget --progress=dot:mega --cut-dirs=4 -r -c -nH -np --reject index.html*,icons/*.gif \ http://*****.oz.xxxxx.com:<portnum>/omcsm/releases/dew/${UPGRADE_VERSION}/ (1 Reply)
Discussion started by: dnam9917
1 Replies

9. Shell Programming and Scripting

wget

Hi I want to download some files using wget , and want to save in a specified directory. Is there any way to save it.Please suggest me. (1 Reply)
Discussion started by: mnmonu
1 Replies

10. Shell Programming and Scripting

wget help

i am trying to ftp files/dirs with wget. i am having an issue where the path always takes me to my home dir even when i specify something else. For example: wget -m ftp://USER:PASS@IP_ADDRESS/Path/on/remote/box ...but if that path on the remote box isn't in my home dir it doesn't change to... (0 Replies)
Discussion started by: djembeplayer
0 Replies
Login or Register to Ask a Question