wget using wildcards using http | Unix Linux Forums | Shell Programming and Scripting

  Go Back    


Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts and shell scripting languages here.

wget using wildcards using http

Shell Programming and Scripting


Closed Thread    
 
Thread Tools Search this Thread Display Modes
    #1  
Old 04-13-2005
hcclnoodles hcclnoodles is offline
Registered User
 
Join Date: Mar 2002
Last Activity: 16 April 2014, 9:56 AM EDT
Posts: 294
Thanks: 0
Thanked 1 Time in 1 Post
wget using wildcards using http

Hi there, probably a really simple question but i want to download all .rpm files from a web repository which happens to be http and not ftp

Ive tried using wget, but as far as i can see it doesnt allow for wilcards (ie wget http://address/*.rpm)

does anybody know i can get all these files in one hit ?

ps - ive tried rsync aswell but to no avail
Sponsored Links
    #2  
Old 04-13-2005
vgersh99's Avatar
vgersh99 vgersh99 is offline Forum Advisor  
Forum Advisor
 
Join Date: Feb 2005
Last Activity: 17 April 2014, 8:07 AM EDT
Location: Foxborough, MA
Posts: 7,523
Thanks: 137
Thanked 534 Times in 502 Posts
Quote:
Originally Posted by hcclnoodles
Hi there, probably a really simple question but i want to download all .rpm files from a web repository which happens to be http and not ftp

Ive tried using wget, but as far as i can see it doesnt allow for wilcards (ie wget http://address/*.rpm)

does anybody know i can get all these files in one hit ?

ps - ive tried rsync aswell but to no avail
Quote:
Originally Posted by man wget
-g on/off --glob=on/off
Turn FTP globbing on or off. By default, globbing will
be turned on if the URL contains a globbing characters
(an asterisk, e.g.). Globbing means you may use the
special characters (wildcards) to retrieve more files
from the same directory at once, like wget
ftp://gnjilux.cc.fer.hr/*.msg. Globbing currently works
only on UNIX FTP servers.
try quoting your URL so that it does not get expanded by the shell:
wget ..... 'http://address/*.rpm'
Sponsored Links
    #3  
Old 04-13-2005
hcclnoodles hcclnoodles is offline
Registered User
 
Join Date: Mar 2002
Last Activity: 16 April 2014, 9:56 AM EDT
Posts: 294
Thanks: 0
Thanked 1 Time in 1 Post
Thanks, but as per your reply, globbing will only work with FTP and not HTTP, thanks anyway though

I also tried quoting the url in both ' and " to no avail ... i still get


ERROR 404: Not Found.

when i quote with ` i get

wget: missing URL
Usage: wget [OPTION]... [URL]...


incidentally my url is

http://download.fedora.redhat.com/pub/fedora/linux/core/updates/1/i386/*.rpm
Sponsored Links
Closed Thread

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Capture http response code from wget jack3698 Shell Programming and Scripting 2 11-18-2010 03:26 AM
HTTP error while downloading solaris patches using wget sunny_a_j Solaris 5 06-21-2010 08:00 AM
Using WGET or CURL to HTTP Post with Authentication krypton Shell Programming and Scripting 2 02-26-2010 11:51 AM
Unable to access http site using wget through proxy memonks Shell Programming and Scripting 2 06-21-2009 01:32 AM
cant make a http get request using wget elthox UNIX for Dummies Questions & Answers 1 02-20-2009 01:49 PM



All times are GMT -4. The time now is 08:58 AM.