Downloading jpgs from a gallery type website Post: 302899542

Sponsored Content

Top Forums Shell Programming and Scripting Downloading jpgs from a gallery type website Post 302899542 by workisnotfun on Tuesday 29th of April 2014 06:24:42 PM

04-29-2014

Registered User

I am having the most trouble with step two I think.

I'm assuming the -oh is the option -o and -h?

Step 1 downloads the files fine but they're stored in my directory as 1.html *dot* , 2.html *dot* etc, with a dot right after (not a period), not sure if this is a problem but Step 2 doesn't seem to be able to find any .html files

and so Step 3 fails because there is no urls.txt. What could be the problem?

---------- Post updated at 05:24 PM ---------- Previous update was at 04:55 PM ----------

I think I might have found a different problem actually.

Running this in terminal works fine

Code:

wget -nd -H -p -A jpg,jpeg,png,gif -e robots=off www.url.example

but when I put this in my bash script and run it I get awaiting response... 404 Not Found. At the end of the jpg url, for some reason a %0D gets appended to the end which I'm thinking makes wget go to the wrong url.

I've been trying a different approach than my earlier one since I couldn't get that working. What could be the problem now so that I can automate the downloading?

Last edited by workisnotfun; 04-29-2014 at 08:13 PM..

workisnotfun

View Public Profile for workisnotfun

Find all posts by workisnotfun

8 More Discussions You Might Find Interesting

1. UNIX Desktop Questions & Answers

Recommendations for good shell utility to resize JPGs?

Not sure if this is the right place to be posting this. If not, let me know where it fits. I am running RedHat Linux 8.0. I've recently acquired a Sony Mavica digital camera. In short, this thing is awesome (uses cd-rw!). I have been taking high quality images, but I now have the need to try...

2. UNIX for Dummies Questions & Answers

Lynx - Downloading - extension handling - changing mime type?

Using Lynx, when I try to download a .rar, it confirms I want to download and its got it as an appication/rar file. However, split archives that end in .r## (.r00, .r01 ...) are not recognized as an appication/rar file and it reads the file like a .txt or .html. How can I fix this? Thanks!

3. Shell Programming and Scripting

String type to date type

Can one string type variable changed into the date type variable.

4. Programming

array type has incomplete element type

Dear colleagues, One of my friend have a problem with c code. While compiling a c program it displays a message like "array type has incomplete element type". Any body can provide a solution for it. Jaganadh.G

5. Shell Programming and Scripting

Downloading info from website to database

Hi guys! I created a database using mysql in bash now i would like to download weather info from the data.(temp, date and time)...and just store this in the database to display after every 3 hours or so... i have tried to get the website using wget and now dont exactly now how to go from here...

6. Shell Programming and Scripting

File Management: How do I move all JPGS in a folder structure to a single folder?

This is the file structure: DESKTOP/Root of Photo Folders/Folder1qweqwasdfsd/*jpg DESKTOP/Root of Photo Folders/Folder2asdasdasd/*jpg DESKTOP/Root of Photo Folders/Folder3asdadfhgasdf/*jpg DESKTOP/Root of Photo Folders/Folder4qwetwdfsdfg/*jpg DESKTOP/Root of Photo...

7. Windows & DOS: Issues & Discussions

Downloading a file from Website to a Windows Folder

Hi, Is it possible to download a file using Wget or some other command from a Windows machine? Say I want to download something from https server to C:\ABC\abc.xls Any ideas, Thanks.

8. Shell Programming and Scripting

Wget error while downloading from https website

Hi, I would like to download a file from a https website. I don't have the file name as it changes every day. I am using the following command: wget --no-check-certificate -r -np --user=ABC --password=DEF -O temp.txt https://<website/directory> I am getting followin error in my...

LEARN ABOUT DEBIAN

gallery-uploader

GALLERY-UPLOADER(1)					   gallery-uploader User Manual 				       GALLERY-UPLOADER(1)

NAME

       gallery-uploader - program to upload pictures and video to Gallery

SYNOPSIS

       gallery-uploader [FILES]

DESCRIPTION

       This manual page documents briefly the gallery-uploader command.

       gallery-uploader is a program that allows to easily upload pictures and video to Gallery installations; Gallery (-
       http://gallery.menalto.com) is an advanced web photo album organizer.

       If FILES are given, they are the files which must be uploaded. If no argument is given instead, a small browser window will open where the
       user can select items to upload.

HOW TO ENABLE AS NAUTILUS SCRIPT

       Nautilus, GNOME's default file manager, supports scripts, which can be activated on any selected file(s) from the right-button menu;
       gallery-uploader plays perfectly the role of a Nautilus script.

       To enable it, the user can run in a terminal the command:

       ln -s /usr/share/nautilus-scripts/Gallery Uploader.py  ~/.gnome2/nautilus-scripts/Gallery Uploader

       or use a program such as nautilus-scripts-manager; see: http://www.pietrobattiston.it/nautilus-scripts-manager.

AUTHOR

       Pietro Battiston <me@pietrobattiston.it>
	   developed the program and wrote this manpage.

COPYRIGHT

       Copyright (C) 2010 Pietro Battiston

       Permission is granted to copy, distribute and/or modify this document under the terms of the GNU General Public License, Version 2 or (at
       your option) any later version published by the Free Software Foundation.

       On Debian systems, the complete text of the GNU General Public License can be found in /usr/share/common-licenses/GPL-2.

gallery-uploader						    03/29/2011						       GALLERY-UPLOADER(1)