10-25-2012
wget -x will save ./www.whatever.com/path/to/index.html
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I'm new to scripting. I'm trying to write a script to download files from ftp site, the following is the script and the message i get after running the script. no files were downloaded :(
Thanks advance!
script:
#!/usr/bin/ksh
DAY=`date --date="-1 days" +%y%m%d`
ftp -v -n "ftp.address" <<... (5 Replies)
Discussion started by: tiff-matt
5 Replies
2. Linux
Hey everyone, my wife has purchased a bundle package of a bunch of images from a site, and now has to download each one of them manually. There are about 500 downloads, and it's quite a hassle to browse to each page and download them all individually.
I would like to write a shell script to... (2 Replies)
Discussion started by: paqman
2 Replies
3. IP Networking
Setup a site to site VPN between two cisco routers.
One of the site locations is unable to access ports such as https://example.com:9001
How do I let them go into port 9001?
They can ssh, ftp, telnet and everything else.
Is this a VPN issue or ACL access issue?
I put
permit ip host... (0 Replies)
Discussion started by: photon
0 Replies
4. Shell Programming and Scripting
Hi,
I have to connect to online site and download some data from the online site but sometimes the site which i have to connect will be busy
or it will not be working in such a case i have to connect atleast 3 times and try to download the data.
I tried like this:
use CGI::Carp... (2 Replies)
Discussion started by: vanitham
2 Replies
5. UNIX for Dummies Questions & Answers
Hi everyone, I am all new to this and I might not know what I am asking about :)
I have access to a cPanel with cron tab scheduler. I know nothing re scripting creating php etc..
I own a ftp mainly for own email address, some storage, and a forum (ready-made one :P )
I have some knowledge... (5 Replies)
Discussion started by: zYx
5 Replies
6. Shell Programming and Scripting
Ok, this is quite weird.
wget -r mysite.com/mylink/
should get all the files recursively from the 'mylink' folder.
The problem is that wget saves an index.html file!
When I open this index.html with my browser I realize that it shows all the files in the current folder (plus an option to move... (3 Replies)
Discussion started by: hakermania
3 Replies
7. Shell Programming and Scripting
Hi there, I'm new to shell scripting and need some help if possible?
I need to create a shell script (.sh) to run as a cron job on an ubuntu linux server to connect to an external sftp sites directory using credentials (which I have) and then download to our internal ftp server and then copy... (3 Replies)
Discussion started by: ghath
3 Replies
8. IP Networking
Hi,
I am trying to establish vpn between my linux server and cisco asa at client side.
I installed openswan on my cent os.
Linux Server
eth0 - 182.2.29.10
Gateway - 182.2.29.1
eth1 - 192.9.200.75
I have simple IPtables Like
WAN="eth0"
LAN="eth1" (0 Replies)
Discussion started by: ashokvpp
0 Replies
9. IP Networking
Q: "Does Cisco 1921 router support,, act as an endpoint for, site to site VPNs using IPSec? If so, how many? "
A: If you get the Cisco 1921/k9 with the security services bundle then it will have built in security features. Cisco, typically includes IP Sec tunnels I believe as part of that... (0 Replies)
Discussion started by: Ayaerlee
0 Replies
10. IP Networking
Hi @all,
I try to connect 2 LANs with IPSec/Openswan
LAN 1: 192.168.0.0/24
LAN 2: 192.168.1.0/24
This is my Config:
conn HomeVPN # # Left security gateway, subnet behind it, nexthop toward right. left=192.168.1.29 ... (1 Reply)
Discussion started by: bahnhasser83
1 Replies
LEARN ABOUT OSX
lwp-download
LWP-DOWNLOAD(1) User Contributed Perl Documentation LWP-DOWNLOAD(1)
NAME
lwp-download - Fetch large files from the web
SYNOPSIS
lwp-download [-a] [-s] <url> [<local path>]
DESCRIPTION
The lwp-download program will save the file at url to a local file.
If local path is not specified, then the current directory is assumed.
If local path is a directory, then the last segment of the path of the url is appended to form a local filename. If the url path ends with
slash the name "index" is used. With the -s option pick up the last segment of the filename from server provided sources like the Content-
Disposition header or any redirect URLs. A file extension to match the server reported Content-Type might also be appended. If a file
with the produced filename already exists, then lwp-download will prompt before it overwrites and will fail if its standard input is not a
terminal. This form of invocation will also fail is no acceptable filename can be derived from the sources mentioned above.
If local path is not a directory, then it is simply used as the path to save into. If the file already exists it's overwritten.
The lwp-download program is implemented using the libwww-perl library. It is better suited to down load big files than the lwp-request
program because it does not store the file in memory. Another benefit is that it will keep you updated about its progress and that you
don't have much options to worry about.
Use the "-a" option to save the file in text (ascii) mode. Might make a difference on dosish systems.
EXAMPLE
Fetch the newest and greatest perl version:
$ lwp-download http://www.perl.com/CPAN/src/latest.tar.gz
Saving to 'latest.tar.gz'...
11.4 MB received in 8 seconds (1.43 MB/sec)
AUTHOR
Gisle Aas <gisle@aas.no>
perl v5.16.2 2012-01-13 LWP-DOWNLOAD(1)