Wget JPG not working


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Wget JPG not working
# 1  
Old 10-14-2012
Wget JPG not working

Hi, I am new to Unix.
Actually, I am using Terminal from MAC OSX Snow Leopard. I have installed XCode and wget 1.14 today.

I just want to download all of the jpg files from a specific blog (from blogspot). But its not working.

Here is the command I use:

wget -r -nd -A jpg come-se

All it does is create a .txt file named robots

Inside this robots.txt there's this:

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Allow: /

Sitemap: come-se



Sorry for the dumb question, but its my first time to Unix and I am still learning. IN fact, Google has helped me a lot, but after searching for dozens of sites and they all say the same about the wget and jpg files and NOTHING worked, I decided to create an account here and ask this.
Hope you can help me.
# 2  
Old 10-14-2012
robots.txt is a file stored on web pages to denote that automatic trawling, like wget, is disallowed.

Search for robots in man wget and you will find more information.
# 3  
Old 10-14-2012
So there's no way I can do that?
# 4  
Old 10-14-2012
Quote:
Originally Posted by bruleke
So there's no way I can do that?
You can try to read about anti robots, robots exclusion.

But not sure, is this possible to use with wget or not.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

2. Shell Programming and Scripting

Grab all jpg's from flickr

Hi everyone, i'm trying to download all the jpg's that my school put on flickr and im trying to do this with wget via a bash script. The pictures that im trying to pull are on this site : and below is my script that doesn't appear to be working (1 Reply)
Discussion started by: binary-ninja
1 Replies

3. Shell Programming and Scripting

print metadata to jpg

Hi all, I would like to write a scipt that gets gps informatoin from a jpg and print 's it on the lower left corner, In order to get the gps data I have found a tool called jhead. In know that with the help of the imagemagick command convert it is possible to print text on the pictures. ... (11 Replies)
Discussion started by: flash80
11 Replies

4. UNIX for Dummies Questions & Answers

Deleting all but JPG files

I would like to delete all files but keep all the .JPG files. How can this be accomplished? Thanks in advance (8 Replies)
Discussion started by: Xterra
8 Replies

5. Shell Programming and Scripting

Rename all ".JPG" files to ".jpg" under all subfolders...

Hi, Dear all: One question ! ^_^ I'm using bash under Ubuntu 9.10. My question is not to rename all ".JPG" files to ".jpg" in a single folder, but to rename all ".JPG" files to ".jpg" in all subfolders. To rename all ".JPG" to ".jpg" in a single folder, for x in *.JPG; do mv "$x"... (7 Replies)
Discussion started by: jiapei100
7 Replies

6. Web Development

is wget working in ftp ?

I get ftp> wget ?Invalid command. ftp> 0 * * * * wget -O - -q -t 1 http://www.example.com/cron.php ?Invalid command. thanks (6 Replies)
Discussion started by: aneuryzma
6 Replies

7. Shell Programming and Scripting

how to send jpg as body

Hi, I ftp the .jpg file from windows to unix machine, now i need to send the jpg file as body to (not as attachment) outlook, can anyone send the sample code for this? (1 Reply)
Discussion started by: vasu.g
1 Replies

8. Shell Programming and Scripting

find jpg's mkdir script help

I am having a problem getting this to work right. The script needs to search through directories and subdirectories. If a jpg is found then create a folder in that directory, so on and so forth. Here is what I have so far but it doesn't work right. Help please #!/bin/bash for d in `find ./... (1 Reply)
Discussion started by: jedhypes
1 Replies

9. AIX

jpg image

Hello I would like to see an jpeg image with aix. It is possible ? how can i do ? thank you (4 Replies)
Discussion started by: pascalbout
4 Replies

10. UNIX for Dummies Questions & Answers

PDF/EPS to GIf/JPG Help!!

Hello. I have a large number of EPS files and a lesser number of PDFs that I need to convert to GIFs/JPGs using a Unix system. Is there a unix utility or application out there that can do this conversion? Thank you in advance for any help you can provide. -Pook (1 Reply)
Discussion started by: PookJP
1 Replies
Login or Register to Ask a Question