slmseg(1) [debian man page]

SLMSEG(1)						User Contributed Perl Documentation						 SLMSEG(1)

NAME

       slmseg - maximum matching segment Chinese text.

SYNOPSIS

       slmseg -d dict_file [option]... [corpus_file]...

DESCRIPTION

       slmseg is a tool for segmenting Chinese text into words using maximum matching algorithm. slmseg segments corpus_file, or standard input if
       no filename is specified, and write the segmented result to standard output.

OPTIONS

       -d dict_file
	   Use dict_file as lexicon. A default lexicon can be found at /usr/share/sunpinyin-slm/dict.utf8.

       -f,--format (text|bin)
	   Output Format, can be 'text' or 'bin'. default 'bin'.  Normally, in text mode, word text are output, while in binary mode, binary short
	   integer of the word-ids are written to stdout.

       -s, --stok STOK_ID
	   Sentence token id. Default 10.  It will be written to output in binary mode after every sentence.

       -i, --show-id
	   Show Id info. Under text output format mode, attach id after known words.  If under binary mode, print id(s) in text.

       -m, --model language-model-file Speficy the language model file. This file is always generated by slmthread.

NOTES

       Under binary mode, consecutive id of 0 are merged into one 0.  Under text mode, no space are inserted between unknown-words.

AUTHOR

       Originally written by Phill.Zhang <phill.zhang@sun.com>.  Currently maintained by Kov.Chai <tchaikov@gmail.com>.

SEE ALSO

       mmseg(1), ids2ngram (1).

perl v5.14.2							    2012-06-09								 SLMSEG(1)

CDTOA(1)						      General Commands Manual							  CDTOA(1)

NAME

       cdtoa - To convert the binary format of a dictionary back to
	       text format.

SYNOPSIS

       cdtoa  [-n] [-s] [-z] [-e] [-E] infilename
	      [-h cixingfile ]	[ usagefreqfile ]

DEFAULT PATH

       /usr/local/bin/cWnn4/cdtoa

DESCRIPTION

       To convert the binary format of the dictionary to text
       format, and output to standard output(stdout).

       infilename is the name of the input binary format
       dictionary.

       The output may be piped into a file by using the ">"
       command.  For example,
	       cdtoa  dict.dic	>  dict.u
       "dict.u" here is the output text format dictionary, while the "dict.dic" is the input binary format dictionary.

       usagefreqfile  may  indicate  more  than one user usage frequency files (for a particular user).  These usage frequency information will be
       reflected in the text format dictionary created.

OPTIONS

       -s     To order the entries in text dictionary according to Pinyin or Zhuyin.

       -n     To attach sequence numbers to the output.

       -z     To convert the binary format back to text format in Zhuyin.
	      (Note: default is Pinyin)

       -e     If the Hanzi inside the text dictionary contains characters such as space and  tab,  they  will  be  compacted  to  special  format.
	      (Default)

       -E     If the Hanzi inside the text dictionary contains characters such as space and tab, they will NOT be compacted to special format.

       -h     cixingfile
	      To specify the Cixing definition file.

NOTE

       1.     The parts in [ ] are options.  They may be omitted.

       2.     The Pinyin and Zhuyin dictionary has the same format.

       3.     The default conversion result of the text dictionary is in Pinyin.

								    13 May 1992 							  CDTOA(1)