check web content - Ksh Post: 302451544

4 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Web content download

There is a web API https://pi.ercot.com/contentproxy/publicList?folder_id=10001937 As soon as this is fired on the browser a page comes in which many files are listed for downloads I want to download all the files ....is it possible to write a shell script which can download the files

2. Shell Programming and Scripting

How to check whether the web page is up without dowloading any content

Hi I am writing a script to check wheather the web page is up and running. I dont want to download the web page.. I I used wget --spider command. but i am not getting anything. can some one tell me the command to the web page.. if the page is up and running I should send a mail to my...

3. Shell Programming and Scripting

Getting web page content and deliver via mail

Guys could you please help. I want to have shell scripts that get the website html content and same time mail html page to DL. Can any1 help here?

4. Shell Programming and Scripting

Trying to submit web form content to a shell script

Hi I was hoping some one could help me with a problem I have. I am trying to collect some information from a web form and save it to a text file. I found an example on this site that is sort of what I am trying to accomplish, the shell script bellow should echo the input back to the browser...

LEARN ABOUT DEBIAN

mirrortool

MIRRORTOOL(1)							OMT documentation.						     MIRRORTOOL(1)

NAME

       mirrortool.pl  -  OpaL Mirror Tool (OMT)

DESCRIPTION

       Creates a mirror of a webpage. It has a number of features such as link rewriting and more. (See the options below).

USAGE

       mirrortool.pl [options] [url] [options] [url] [...]

OPTIONS

	  --images	       : Include <img src=xxx>:s in the download. (default)
	  --noimages	       : Do not include <img src=xxx>:s in the download.
	  --depth n	       : Maximum recursion depth. (default 1)
	  --store "regexp"     : Files matching regexp are actually stored locally.
			       : It is possible to | separate (with or).
	  --rewrite "from=>to" : Urls are rewritten using this rules.
			       : It is possible to | separate (with or).
			       : Do not rewrite the dir, because that it will affect
			       : later lookup. Have to fix this sometime.
	  --what "regexp"      : Files matching regexp are downloaded and traversed.
			       : It is possible to | separate (with or).
	  --dir basedir        : Where to store local files.
	  --nohostcheck        : Do not check if url points to other host.
	  --notreecheck        : Do not check if url points to other dirtree.
	  --force	       : Overwrite all files.
	  --debug	       : Print debug-messages.
	  --retry n	       : Number of times an url will be retried (default 1)
	  --auth user:pass     : use Basic Authentication
	  --proxy url	       : Use a proxy server (like http://u:p@localhost/).
	  --help	       : Print this text.

AUTHOR

       Ola Lundqvist <opal@lysator.liu.se>

SEE ALSO

       mirrortool.pl(1)

perl v5.8.8							    2002-04-15							     MIRRORTOOL(1)