Wget JPG not working | Unix Linux Forums | UNIX for Dummies Questions & Answers

  Go Back    


UNIX for Dummies Questions & Answers If you're not sure where to post a UNIX or Linux question, post it here. All UNIX and Linux newbies welcome !!

Wget JPG not working

UNIX for Dummies Questions & Answers


Closed Thread    
 
Thread Tools Search this Thread Display Modes
    #1  
Old 10-14-2012
bruleke bruleke is offline
Registered User
 
Join Date: Oct 2012
Last Activity: 15 October 2012, 10:12 PM EDT
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
Wget JPG not working

Hi, I am new to Unix.
Actually, I am using Terminal from MAC OSX Snow Leopard. I have installed XCode and wget 1.14 today.

I just want to download all of the jpg files from a specific blog (from blogspot). But its not working.

Here is the command I use:

wget -r -nd -A jpg come-se

All it does is create a .txt file named robots

Inside this robots.txt there's this:

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Allow: /

Sitemap: come-se



Sorry for the dumb question, but its my first time to Unix and I am still learning. IN fact, Google has helped me a lot, but after searching for dozens of sites and they all say the same about the wget and jpg files and NOTHING worked, I decided to create an account here and ask this.
Hope you can help me.
Sponsored Links
    #2  
Old 10-14-2012
Corona688 Corona688 is offline Forum Staff  
Mead Rotor
 
Join Date: Aug 2005
Last Activity: 30 September 2014, 4:14 PM EDT
Location: Saskatchewan
Posts: 19,477
Thanks: 794
Thanked 3,286 Times in 3,081 Posts
robots.txt is a file stored on web pages to denote that automatic trawling, like wget, is disallowed.

Search for robots in man wget and you will find more information.
Sponsored Links
    #3  
Old 10-14-2012
bruleke bruleke is offline
Registered User
 
Join Date: Oct 2012
Last Activity: 15 October 2012, 10:12 PM EDT
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
So there's no way I can do that?
    #4  
Old 10-14-2012
pamu pamu is offline
Registered User
 
Join Date: Mar 2012
Last Activity: 15 September 2014, 8:06 AM EDT
Posts: 1,649
Thanks: 58
Thanked 478 Times in 474 Posts
Quote:
Originally Posted by bruleke View Post
So there's no way I can do that?
You can try to read about anti robots, robots exclusion.

But not sure, is this possible to use with wget or not.
Sponsored Links
Closed Thread

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Script not working in cron but working fine manually jasperux Shell Programming and Scripting 2 07-05-2012 12:37 AM
Script is not working from cron while working manually anuragpgtgerman Shell Programming and Scripting 3 01-23-2012 01:54 PM
is wget working in ftp ? aneuryzma Web Programming 6 09-14-2009 02:52 AM
Help with wget vadharah Shell Programming and Scripting 2 03-30-2008 02:42 AM
wget help djembeplayer Shell Programming and Scripting 0 04-06-2007 10:33 AM



All times are GMT -4. The time now is 05:55 PM.