Wget JPG not working | Unix Linux Forums | UNIX for Dummies Questions & Answers

  Unix/Linux Go Back    


UNIX for Dummies Questions & Answers If you're not sure where to post a UNIX or Linux question, post it here. All UNIX and Linux newbies welcome !!

Wget JPG not working

UNIX for Dummies Questions & Answers


Closed Linux or Unix Question    
 
Thread Tools Search this Thread Display Modes
    #1  
Old Unix and Linux 10-14-2012
bruleke bruleke is offline
Registered User
 
Join Date: Oct 2012
Last Activity: 15 October 2012, 10:12 PM EDT
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
Wget JPG not working

Hi, I am new to Unix.
Actually, I am using Terminal from MAC OSX Snow Leopard. I have installed XCode and wget 1.14 today.

I just want to download all of the jpg files from a specific blog (from blogspot). But its not working.

Here is the command I use:

wget -r -nd -A jpg come-se

All it does is create a .txt file named robots

Inside this robots.txt there's this:

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Allow: /

Sitemap: come-se



Sorry for the dumb question, but its my first time to Unix and I am still learning. IN fact, Google has helped me a lot, but after searching for dozens of sites and they all say the same about the wget and jpg files and NOTHING worked, I decided to create an account here and ask this.
Hope you can help me.
Sponsored Links
    #2  
Old Unix and Linux 10-14-2012
Corona688 Corona688 is online now Forum Staff  
Mead Rotor
 
Join Date: Aug 2005
Last Activity: 4 March 2015, 1:19 PM EST
Location: Saskatchewan
Posts: 20,346
Thanks: 870
Thanked 3,564 Times in 3,329 Posts
robots.txt is a file stored on web pages to denote that automatic trawling, like wget, is disallowed.

Search for robots in man wget and you will find more information.
Sponsored Links
    #3  
Old Unix and Linux 10-14-2012
bruleke bruleke is offline
Registered User
 
Join Date: Oct 2012
Last Activity: 15 October 2012, 10:12 PM EDT
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
So there's no way I can do that?
    #4  
Old Unix and Linux 10-14-2012
pamu pamu is offline
Registered User
 
Join Date: Mar 2012
Last Activity: 7 November 2014, 10:50 AM EST
Posts: 1,650
Thanks: 58
Thanked 478 Times in 474 Posts
Quote:
Originally Posted by bruleke View Post
So there's no way I can do that?
You can try to read about anti robots, robots exclusion.

But not sure, is this possible to use with wget or not.
Sponsored Links
Closed Linux or Unix Question

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Unix or Linux Image More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Script not working in cron but working fine manually jasperux Shell Programming and Scripting 2 07-05-2012 01:37 AM
Script is not working from cron while working manually anuragpgtgerman Shell Programming and Scripting 3 01-23-2012 02:54 PM
is wget working in ftp ? aneuryzma Web Programming 6 09-14-2009 03:52 AM
Help with wget vadharah Shell Programming and Scripting 2 03-30-2008 03:42 AM
wget help djembeplayer Shell Programming and Scripting 0 04-06-2007 11:33 AM



All times are GMT -4. The time now is 02:46 PM.