10-14-2012
Wget JPG not working
Hi, I am new to Unix.
Actually, I am using Terminal from MAC OSX Snow Leopard. I have installed XCode and wget 1.14 today.
I just want to download all of the jpg files from a specific blog (from blogspot). But its not working.
Here is the command I use:
wget -r -nd -A jpg
come-se
All it does is create a .txt file named robots
Inside this robots.txt there's this:
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: come-se
Sorry for the dumb question, but its my first time to Unix and I am still learning. IN fact, Google has helped me a lot, but after searching for dozens of sites and they all say the same about the wget and jpg files and NOTHING worked, I decided to create an account here and ask this.
Hope you can help me.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hello.
I have a large number of EPS files and a lesser number of PDFs that I need to convert to GIFs/JPGs using a Unix system. Is there a unix utility or application out there that can do this conversion?
Thank you in advance for any help you can provide.
-Pook (1 Reply)
Discussion started by: PookJP
1 Replies
2. AIX
Hello
I would like to see an jpeg image with aix. It is possible ?
how can i do ?
thank you (4 Replies)
Discussion started by: pascalbout
4 Replies
3. Shell Programming and Scripting
I am having a problem getting this to work right. The script needs to search through directories and subdirectories. If a jpg is found then create a folder in that directory, so on and so forth. Here is what I have so far but it doesn't work right. Help please
#!/bin/bash
for d in `find ./... (1 Reply)
Discussion started by: jedhypes
1 Replies
4. Shell Programming and Scripting
Hi,
I ftp the .jpg file from windows to unix machine, now i need to send the jpg file as body to (not as attachment) outlook, can anyone send the sample code for this? (1 Reply)
Discussion started by: vasu.g
1 Replies
5. Web Development
I get
ftp> wget
?Invalid command.
ftp> 0 * * * * wget -O - -q -t 1 http://www.example.com/cron.php
?Invalid command.
thanks (6 Replies)
Discussion started by: aneuryzma
6 Replies
6. Shell Programming and Scripting
Hi, Dear all:
One question ! ^_^
I'm using bash under Ubuntu 9.10.
My question is not to rename all ".JPG" files to ".jpg" in a single folder, but to rename all ".JPG" files to ".jpg" in all subfolders.
To rename all ".JPG" to ".jpg" in a single folder,
for x in *.JPG; do mv "$x"... (7 Replies)
Discussion started by: jiapei100
7 Replies
7. UNIX for Dummies Questions & Answers
I would like to delete all files but keep all the .JPG files.
How can this be accomplished?
Thanks in advance (8 Replies)
Discussion started by: Xterra
8 Replies
8. Shell Programming and Scripting
Hi all,
I would like to write a scipt that gets gps informatoin from a jpg and print 's it on the lower left corner, In order to get the gps data I have found a tool called jhead. In know that with the help of the imagemagick command convert it is possible to print text on the pictures.
... (11 Replies)
Discussion started by: flash80
11 Replies
9. Shell Programming and Scripting
Hi everyone, i'm trying to download all the jpg's that my school put on flickr and im trying to do this with wget via a bash script.
The pictures that im trying to pull are on this site : and below is my script that doesn't appear to be working (1 Reply)
Discussion started by: binary-ninja
1 Replies
10. Shell Programming and Scripting
Hi,
I need to download a zip file from my the below US govt link.
https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP
I only have wget utility installed on the server.
When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies
LEARN ABOUT DEBIAN
httpindex
httpindex(1) General Commands Manual httpindex(1)
NAME
httpindex - HTTP front-end for SWISH++ indexer
SYNOPSIS
wget [ options ] URL... 2>&1 | httpindex [ options ]
DESCRIPTION
httpindex is a front-end for index++(1) to index files copied from remote servers using wget(1). The files (in a copy of the remote direc-
tory structure) can be kept, deleted, or replaced with their descriptions after indexing.
OPTIONS
wget Options
The wget(1) options that are required are: -A, -nv, -r, and -x; the ones that are highly recommended are: -l, -nh, -t, and -w. (See the
EXAMPLE.)
httpindex Options
httpindex accepts the same short options as index++(1) except for -H, -I, -l, -r, -S, and -V.
The following options are unique to httpindex:
-d Replace the text of local copies of retrieved files with their descriptions after they have been indexed. This is useful to display
file descriptions in search results without having to have complete copies of the remote files thus saving filesystem space. (See
the extract_description() function in WWW(3) for details about how descriptions are extracted.)
-D Delete the local copies of retrieved files after they have been indexed. This prevents your local filesystem from filling up with
copies of remote files.
EXAMPLE
To index all HTML and text files on a remote web server keeping descriptions locally:
wget -A html,txt -linf -t2 -rxnv -nh -w2 http://www.foo.com 2>&1 |
httpindex -d -e'html:*.html,text:*.txt'
Note that you need to redirect wget(1)'s output from standard error to standard output in order to pipe it to httpindex.
EXIT STATUS
Exits with a value of zero only if indexing completed sucessfully; non-zero otherwise.
CAVEATS
In addition to those for index++(1), httpindex does not correctly handle the use of multiple -e, -E, -m, or -M options (because the Perl
script uses the standard GetOpt::Std package for processing command-line options that doesn't). The last of any of those options ``wins.''
The work-around is to use multiple values for those options seperated by commas to a single one of those options. For example, if you want
to do:
httpindex -e'html:*.html' -e'text:*.txt'
do this instead:
httpindex -e'html:*.html,text:*.txt'
SEE ALSO
index++(1), wget(1), WWW(3)
AUTHOR
Paul J. Lucas <pauljlucas@mac.com>
SWISH++ August 2, 2005 httpindex(1)