Wget JPG not working | Unix Linux Forums | UNIX for Dummies Questions & Answers

  Unix/Linux Go Back    


UNIX for Dummies Questions & Answers If you're not sure where to post a UNIX or Linux question, post it here. All UNIX and Linux newbies welcome !!

Wget JPG not working

UNIX for Dummies Questions & Answers


Closed Linux or Unix Question    
 
Thread Tools Search this Thread Display Modes
    #1  
Old Unix and Linux 10-14-2012
bruleke bruleke is offline
Registered User
 
Join Date: Oct 2012
Last Activity: 15 October 2012, 10:12 PM EDT
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
Wget JPG not working

Hi, I am new to Unix.
Actually, I am using Terminal from MAC OSX Snow Leopard. I have installed XCode and wget 1.14 today.

I just want to download all of the jpg files from a specific blog (from blogspot). But its not working.

Here is the command I use:

wget -r -nd -A jpg come-se

All it does is create a .txt file named robots

Inside this robots.txt there's this:

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Allow: /

Sitemap: come-se



Sorry for the dumb question, but its my first time to Unix and I am still learning. IN fact, Google has helped me a lot, but after searching for dozens of sites and they all say the same about the wget and jpg files and NOTHING worked, I decided to create an account here and ask this.
Hope you can help me.
Sponsored Links
    #2  
Old Unix and Linux 10-14-2012
Corona688 Corona688 is offline Forum Staff  
Mead Rotor
 
Join Date: Aug 2005
Last Activity: 27 March 2015, 5:33 PM EDT
Location: Saskatchewan
Posts: 20,390
Thanks: 873
Thanked 3,575 Times in 3,340 Posts
robots.txt is a file stored on web pages to denote that automatic trawling, like wget, is disallowed.

Search for robots in man wget and you will find more information.
Sponsored Links
    #3  
Old Unix and Linux 10-14-2012
bruleke bruleke is offline
Registered User
 
Join Date: Oct 2012
Last Activity: 15 October 2012, 10:12 PM EDT
Posts: 3
Thanks: 0
Thanked 0 Times in 0 Posts
So there's no way I can do that?
    #4  
Old Unix and Linux 10-14-2012
pamu pamu is offline
Registered User
 
Join Date: Mar 2012
Last Activity: 7 November 2014, 10:50 AM EST
Posts: 1,650
Thanks: 58
Thanked 478 Times in 474 Posts
Quote:
Originally Posted by bruleke View Post
So there's no way I can do that?
You can try to read about anti robots, robots exclusion.

But not sure, is this possible to use with wget or not.
Sponsored Links
Closed Linux or Unix Question

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Unix or Linux Image More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Script not working in cron but working fine manually jasperux Shell Programming and Scripting 2 07-05-2012 12:37 AM
Script is not working from cron while working manually anuragpgtgerman Shell Programming and Scripting 3 01-23-2012 01:54 PM
is wget working in ftp ? aneuryzma Web Programming 6 09-14-2009 02:52 AM
Help with wget vadharah Shell Programming and Scripting 2 03-30-2008 02:42 AM
wget help djembeplayer Shell Programming and Scripting 0 04-06-2007 10:33 AM



All times are GMT -4. The time now is 03:22 AM.