text::english(3pm) [debian man page]

Text::English(3pm)					User Contributed Perl Documentation					Text::English(3pm)

NAME

       Text::English - Porter's stemming algorithm

SYNOPSIS

	   use Text::English;
	   @stems = Text::English::stem( @words );

DESCRIPTION

       This routine applies the Porter Stemming Algorithm to its parameters, returning the stemmed words.  It is derived from the C program
       "stemmer.c" as found in freewais and elsewhere, which contains these notes:

	  Purpose:    Implementation of the Porter stemming algorithm documented
		      in: Porter, M.F., "An Algorithm For Suffix Stripping,"
		      Program 14(3), July 1980, pp. 130-137.
	  Provenance: Written by B. Frakes and C. Cox, 1986.

       I have re-interpreted areas that use Frakes and Cox's "WordSize" function. My version may misbehave on short words starting with "y", but I
       can't think of any examples.

       The step numbers correspond to Frakes and Cox, and are probably in Porter's article (which I've not seen).  Porter's algorithm still has
       rough spots (e.g current/currency, -ings words), which I've not attempted to cure, although I have added support for the British -ise
       suffix.

NOTES

       This is version 0.1. I would welcome feedback, especially improvements to the punctuation-stripping step.

AUTHOR

       Ian Phillipps <ian@unipalm.pipex.com>

COPYRIGHT

       Copyright Public IP Exchange Ltd (PIPEX).  Available for use under the same terms as perl.

perl v5.14.2							    2005-04-10							Text::English(3pm)

Plucene::Analysis::PorterStemFilter(3pm)		User Contributed Perl Documentation		  Plucene::Analysis::PorterStemFilter(3pm)

NAME

       Plucene::Analysis::PorterStemFilter - Porter stemming on the token stream

SYNOPSIS

	       # isa Plucene::Analysis:::TokenFilter

	       my $token = $porter_stem_filter->next;

DESCRIPTION

       This class transforms the token stream as per the Porter stemming algorithm.

       Note: the input to the stemming filter must already be in lower case, so you will need to use LowerCaseFilter or LowerCaseTokenizer farther
       down the Tokenizer chain in order for this to work properly!

       The Porter Stemmer implements Porter Algorithm for normalization of English words by stripping their extensions and is used to generalize
       the searches.  For example, the Porter algorithm maps both 'search' and 'searching' (as well as 'searchnessing') to 'search' such that a
       query for 'search' will also match documents that contains the word 'searching'.

       Note that the Porter algorithm is specific to the English language and may give unpredictable results for other languages. Also, make sure
       to use the same analyzer during the indexing and the searching.

       You can find more information on the Porter algorithm at www.tartarus.org/~martin/PorterStemmer.

       A nice online demonstration of the Porter algorithm is available at www.scs.carleton.ca/~dquesnel/java/stuff/PorterApplet.html.

METHODS

   next
	       my $token = $porter_stem_filter->next;

       Returns the next input token, after being stemmed.

perl v5.12.4							    2011-08-14				  Plucene::Analysis::PorterStemFilter(3pm)