Wget JPG not working | Unix Linux Forums | UNIX for Dummies Questions & Answers

  Go Back    


UNIX for Dummies Questions & Answers If you're not sure where to post a UNIX or Linux question, post it here. All UNIX and Linux newbies welcome !!

Wget JPG not working

UNIX for Dummies Questions & Answers


Closed Thread    
 
Thread Tools Search this Thread Display Modes
    #1  
Old 10-14-2012
bruleke bruleke is offline
Registered User
 
Join Date: Oct 2012
Last Activity: 15 October 2012, 10:12 PM EDT
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
Wget JPG not working

Hi, I am new to Unix.
Actually, I am using Terminal from MAC OSX Snow Leopard. I have installed XCode and wget 1.14 today.

I just want to download all of the jpg files from a specific blog (from blogspot). But its not working.

Here is the command I use:

wget -r -nd -A jpg come-se

All it does is create a .txt file named robots

Inside this robots.txt there's this:

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Allow: /

Sitemap: come-se



Sorry for the dumb question, but its my first time to Unix and I am still learning. IN fact, Google has helped me a lot, but after searching for dozens of sites and they all say the same about the wget and jpg files and NOTHING worked, I decided to create an account here and ask this.
Hope you can help me.
Sponsored Links
    #2  
Old 10-14-2012
Corona688 Corona688 is offline Forum Staff  
Mead Rotor
 
Join Date: Aug 2005
Last Activity: 27 November 2014, 5:33 PM EST
Location: Saskatchewan
Posts: 19,943
Thanks: 848
Thanked 3,421 Times in 3,206 Posts
robots.txt is a file stored on web pages to denote that automatic trawling, like wget, is disallowed.

Search for robots in man wget and you will find more information.
Sponsored Links
    #3  
Old 10-14-2012
bruleke bruleke is offline
Registered User
 
Join Date: Oct 2012
Last Activity: 15 October 2012, 10:12 PM EDT
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
So there's no way I can do that?
    #4  
Old 10-14-2012
pamu pamu is offline
Registered User
 
Join Date: Mar 2012
Last Activity: 7 November 2014, 10:50 AM EST
Posts: 1,650
Thanks: 58
Thanked 478 Times in 474 Posts
Quote:
Originally Posted by bruleke View Post
So there's no way I can do that?
You can try to read about anti robots, robots exclusion.

But not sure, is this possible to use with wget or not.
Sponsored Links
Closed Thread

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Script not working in cron but working fine manually jasperux Shell Programming and Scripting 2 07-05-2012 01:37 AM
Script is not working from cron while working manually anuragpgtgerman Shell Programming and Scripting 3 01-23-2012 02:54 PM
is wget working in ftp ? aneuryzma Web Programming 6 09-14-2009 03:52 AM
Help with wget vadharah Shell Programming and Scripting 2 03-30-2008 03:42 AM
wget help djembeplayer Shell Programming and Scripting 0 04-06-2007 11:33 AM



All times are GMT -4. The time now is 11:46 AM.