httpindex(1) [debian man page]

httpindex(1)						      General Commands Manual						      httpindex(1)

NAME

       httpindex - HTTP front-end for SWISH++ indexer

SYNOPSIS

       wget [ options ] URL...	2>&1 | httpindex [ options ]

DESCRIPTION

       httpindex is a front-end for index++(1) to index files copied from remote servers using wget(1).  The files (in a copy of the remote direc-
       tory structure) can be kept, deleted, or replaced with their descriptions after indexing.

OPTIONS

   wget Options
       The wget(1) options that are required are: -A, -nv, -r, and -x; the ones that are highly recommended are: -l, -nh, -t, and  -w.	 (See  the
       EXAMPLE.)

   httpindex Options
       httpindex accepts the same short options as index++(1) except for -H, -I, -l, -r, -S, and -V.

       The following options are unique to httpindex:

       -d     Replace the text of local copies of retrieved files with their descriptions after they have been indexed.  This is useful to display
	      file descriptions in search results without having to have complete copies of the remote files thus saving filesystem  space.   (See
	      the extract_description() function in WWW(3) for details about how descriptions are extracted.)

       -D     Delete  the  local copies of retrieved files after they have been indexed.  This prevents your local filesystem from filling up with
	      copies of remote files.

EXAMPLE

       To index all HTML and text files on a remote web server keeping descriptions locally:

	    wget -A html,txt -linf -t2 -rxnv -nh -w2 http://www.foo.com 2>&1 |
	    httpindex -d -e'html:*.html,text:*.txt'

       Note that you need to redirect wget(1)'s output from standard error to standard output in order to pipe it to httpindex.

EXIT STATUS

       Exits with a value of zero only if indexing completed sucessfully; non-zero otherwise.

CAVEATS

       In addition to those for index++(1), httpindex does not correctly handle the use of multiple -e, -E, -m, or -M options  (because  the  Perl
       script uses the standard GetOpt::Std package for processing command-line options that doesn't).	The last of any of those options ``wins.''

       The work-around is to use multiple values for those options seperated by commas to a single one of those options.  For example, if you want
       to do:

	    httpindex -e'html:*.html' -e'text:*.txt'

       do this instead:

	    httpindex -e'html:*.html,text:*.txt'

SEE ALSO

       index++(1), wget(1), WWW(3)

AUTHOR

       Paul J. Lucas <pauljlucas@mac.com>

SWISH++ 							  August 2, 2005						      httpindex(1)

HXINCL(1)							  HTML-XML-utils							 HXINCL(1)

NAME

       hxincl - expand included HTML or XML files

SYNOPSIS

       hxincl [ -x ] [ -f ] [ -s name=subst ] [ -s name=subst ]...  [ -b base ] [ file-or-URL ]

DESCRIPTION

       The  hxincl  command  copies  an  HTML  or  XML	file to standard output, looking for comments with a certain structure.  Such a comment is
       replaced by the file whose name is given as the attribute of the directive. For example:

	   ...<!-- include "foo.html" -->...

       will be replaced by the content of the file foo.html.  It is important to note that you must quote filenames if they contain white space.

       The comment is replaced by

	   <!-- begin-include "foo.html" -->

       before the included text and

	   <!-- end-include "foo.html" -->

       after it. These comments make it possible to run hxincl on the resulting file again to update the inclusions.

       Single quotes are allowed instead of double quotes. And if the file name contains no spaces, the quotes may also be omitted.

OPTIONS

       The following options are supported:

       -x	 Use XML conventions: empty elements are written with a slash at the end: <IMG />.

       -b base	 Sets the base URL for resolving relative URLs. By default the file given as argument is the base URL.

       -f	 Removes the comments after including the files. This means hxincl connot be run on the resulting file later to update the  inclu-
		 sions.  (Mnemonic: final or frozen.)

       -s name=substitution
		 Include a different file than the one mentioned in the directive. If the comment is

		     <!-- include "name" -->

		 the file substitution is included instead. The option -s may occur multiple times.

OPERANDS

       The following operand is supported:

       file-or-URL
		 The name of an HTML or XML file or the URL of one. If absent, standard input is read instead.

EXIT STATUS

       The following exit values are returned:

       0	 Successful completion.

       > 0	 An error occurred in the parsing of one of the HTML or XML files.

ENVIRONMENT

       To use a proxy to retrieve remote files, set the environment variables http_proxy or ftp_proxy.	E.g., http_proxy="http://localhost:8080/"

BUGS

       Assumes UTF-8 as input. Doesn't expand character entities. Instead pipe the input through hxunent(1) and asc2xml(1) to convert it to UTF-8.

       Remote  files (specified with a URL) are currently only supported for HTTP. Password-protected files or files that depend on HTTP "cookies"
       are not handled. (You can use tools such as curl(1) or wget(1) to retrieve such files.)

SEE ALSO

       asc2xml(1), hxnormalize(1), hxnum(1), hxprune(1), hxtoc(1), hxunent(1), xml2asc(1), UTF-8 (RFC 2279)

6.x								    10 Jul 2011 							 HXINCL(1)