debian plucene::analysis::lettertokenizer man page on unix.com

Debian Man Pages All Man Pages Latest Topics Forum Categories

Query: plucene::analysis::lettertokenizer

OS: debian

Section: 3pm

Format: Original Unix Latex Style Formatted with HTML and a Horizontal Scroll Bar

Plucene::Analysis::LetterTokenizer(3pm) 		User Contributed Perl Documentation		   Plucene::Analysis::LetterTokenizer(3pm)

NAME
       Plucene::Analysis::LetterTokenizer - Letter tokenizer

SYNOPSIS
	       # isa Plucene::Analysis::CharTokenizer

DESCRIPTION
       This is the letter tokenizer class, which divides text at non-letters.

       Note: this does a decent job for most European languages, but does a terrible job for some Asian languages, where words are not separated
       by spaces

perl v5.12.4							    2011-08-14				   Plucene::Analysis::LetterTokenizer(3pm)

debian man page for plucene::analysis::lettertokenizer