mirrortool(1) [debian man page]

MIRRORTOOL(1)							OMT documentation.						     MIRRORTOOL(1)

NAME

       mirrortool.pl  -  OpaL Mirror Tool (OMT)

DESCRIPTION

       Creates a mirror of a webpage. It has a number of features such as link rewriting and more. (See the options below).

USAGE

       mirrortool.pl [options] [url] [options] [url] [...]

OPTIONS

	  --images	       : Include <img src=xxx>:s in the download. (default)
	  --noimages	       : Do not include <img src=xxx>:s in the download.
	  --depth n	       : Maximum recursion depth. (default 1)
	  --store "regexp"     : Files matching regexp are actually stored locally.
			       : It is possible to | separate (with or).
	  --rewrite "from=>to" : Urls are rewritten using this rules.
			       : It is possible to | separate (with or).
			       : Do not rewrite the dir, because that it will affect
			       : later lookup. Have to fix this sometime.
	  --what "regexp"      : Files matching regexp are downloaded and traversed.
			       : It is possible to | separate (with or).
	  --dir basedir        : Where to store local files.
	  --nohostcheck        : Do not check if url points to other host.
	  --notreecheck        : Do not check if url points to other dirtree.
	  --force	       : Overwrite all files.
	  --debug	       : Print debug-messages.
	  --retry n	       : Number of times an url will be retried (default 1)
	  --auth user:pass     : use Basic Authentication
	  --proxy url	       : Use a proxy server (like http://u:p@localhost/).
	  --help	       : Print this text.

AUTHOR

       Ola Lundqvist <opal@lysator.liu.se>

SEE ALSO

       mirrortool.pl(1)

perl v5.8.8							    2002-04-15							     MIRRORTOOL(1)

LWP-DOWNLOAD(1) 					User Contributed Perl Documentation					   LWP-DOWNLOAD(1)

NAME

       lwp-download - Fetch large files from the web

SYNOPSIS

       lwp-download [-a] [-s] <url> [<local path>]

DESCRIPTION

       The lwp-download program will save the file at url to a local file.

       If local path is not specified, then the current directory is assumed.

       If local path is a directory, then the last segment of the path of the url is appended to form a local filename.  If the url path ends with
       slash the name "index" is used.	With the -s option pick up the last segment of the filename from server provided sources like the Content-
       Disposition header or any redirect URLs.  A file extension to match the server reported Content-Type might also be appended.  If a file
       with the produced filename already exists, then lwp-download will prompt before it overwrites and will fail if its standard input is not a
       terminal.  This form of invocation will also fail is no acceptable filename can be derived from the sources mentioned above.

       If local path is not a directory, then it is simply used as the path to save into.  If the file already exists it's overwritten.

       The lwp-download program is implemented using the libwww-perl library.  It is better suited to down load big files than the lwp-request
       program because it does not store the file in memory.  Another benefit is that it will keep you updated about its progress and that you
       don't have much options to worry about.

       Use the "-a" option to save the file in text (ascii) mode.  Might make a difference on dosish systems.

EXAMPLE

       Fetch the newest and greatest perl version:

	$ lwp-download http://www.perl.com/CPAN/src/latest.tar.gz
	Saving to 'latest.tar.gz'...
	11.4 MB received in 8 seconds (1.43 MB/sec)

AUTHOR

       Gisle Aas <gisle@aas.no>

perl v5.12.1							    2010-07-05							   LWP-DOWNLOAD(1)