The UNIX and Linux Forums  
Hello and Welcome from United States to the UNIX and Linux Forums! Thank You for Visiting and Joining Our Global Community.

Go Back   The UNIX and Linux Forums > Operating Systems > Linux
.
google unix.com



Linux RedHat, Ubuntu, SUSE, Fedora, Debian, Mandriva, Slackware, Gentoo linux, PCLinuxOS. All Linux questions here!

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
shell script not connecting to primary from standby site a1_win Shell Programming and Scripting 0 10-23-2008 05:22 AM
script for download files from ftp site tiff-matt Shell Programming and Scripting 5 09-19-2008 03:46 PM
Pulling a list of files from FTP site in a shell script spatra Shell Programming and Scripting 0 08-28-2008 08:03 AM
Shell script for FTP download moorthygs Shell Programming and Scripting 2 09-05-2007 05:34 AM
Automatic download of csv file using a shell script figaro Shell Programming and Scripting 1 01-13-2007 08:53 PM

 
English Japanese Spanish French German Portuguese Italian Dutch Swedish Russian Norwegian Hungarian Hebrew Danish Bulgarian Greek Powered by Powered by Google
 
LinkBack Thread Tools Search this Thread Rate Thread Display Modes
Prev Previous Post   Next Post Next
  #1 (permalink)  
Old 11-26-2008
paqman paqman is offline
Registered User
  
 

Join Date: Jul 2007
Posts: 21
shell script to download files from a site?

Hey everyone, my wife has purchased a bundle package of a bunch of images from a site, and now has to download each one of them manually. There are about 500 downloads, and it's quite a hassle to browse to each page and download them all individually.

I would like to write a shell script to just go out and grab all the links and do it all automatically, but one part of the script eludes me.

She has an email that contains the initial links to all the download pages. I'm pretty sure I could manipulate the data in that page, and get all those links out and into a file. Then from there, I would do a for loop and loop through that file. So what I would need to do from there is have the script go to each link, then get the source code from that page. At that point, I could manipulate the data in that file and grab the link for the file in there. This is where it gets a little tricky. I can't just tell it to download that link, because it's just a php page that initiates the download for you. So I would have to have it hit the link, and tell it to save the file somewhere.

If all I could do was get it to hit the link for me, that would still save a lot of time. Then we could just sit there while it runs, and click "Save" on every one.

Anyone have any ideas?

Thanks.
 

Bookmarks

Tags
shell script, shell scripting, unix scripting, unix scripting basics

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On




All times are GMT -4. The time now is 06:21 AM.


Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited. Language Translations Powered by .
vBCredits v1.4 Copyright ©2007 - 2008, PixelFX Studios
The UNIX and Linux Forums Content Copyright ©1993-2009. All Rights Reserved.Ad Management by RedTyger

Content Relevant URLs by vBSEO 3.2.0