Linux and UNIX Man Pages

Linux & Unix Commands - Search Man Pages

ids2ngram(1) [debian man page]

IDS2NGRAM(1)						User Contributed Perl Documentation					      IDS2NGRAM(1)

NAME
ids2ngram - generate n-gram data file from ids file SYNOPSIS
ids2ngram [option]... ids_file... DESCRIPTION
ids2ngram generates idngram file, which is a sorted [id1,..,idN,freq] array, from binary id stream files. Here, the id stream files are always generated by mmseg or slmseg. Basically, it finds all occurrence of n-words tuples (i.e. the tuple of (id1,..,idN)), and sorts these tuples by the lexicographic order of the ids make up the tuples, then write them to specified output file. INPUT
The input file is presented as a binary id stream, which looks like: [id0,...,idX] OPTIONS
All the following options are mandatory. -n,--NMax N Generates N-gram result. ids2ngram does only support uni-gram, bi-gram, and trigram, so any number not in the range of 1..3 is not valid. -s,--swap swap-file Specify the temporary intermediate file. -o, --out output-file Specify the result idngram file, e.g. the array of [id1, ..., idN, freq] -p, --para N Specify the maximum n-gram items per paragraph. ids2ngram writes to the temporary file on a per-paragraph basis. Every time it writes a paragraph out, it frees the corresponding memory allocated for it. When your computer system permits, a higher N is suggested. This can speed up the processing speed because of less I/O. EXAMPLE
Following example will use three input idstream file idsfile[1,2,3] to generate the idngram file all.id3gram. Each para (internal map size or hash size) would be 1024000, using swap file for temp result. All temp para result would eventually be merged to got the final result. ids2ngram -n 3 -s /tmp/swap -o all.id3gram -p 1024000 idsfile1 idsfile2 idsfile3 AUTHOR
Originally written by Phill.Zhang <phill.zhang@sun.com>. Currently maintained by Kov.Chai <tchaikov@gmail.com>. SEE ALSO
mmseg(1), slmseg(1), slmbuild (1). perl v5.14.2 2012-06-09 IDS2NGRAM(1)

Check Out this Related Man Page

Glib::Flags(3pm)					User Contributed Perl Documentation					  Glib::Flags(3pm)

NAME
Glib::Flags - Overloaded operators representing GLib flags HIERARCHY
Glib::Flags DESCRIPTION
Glib maps flag and enum values to the nicknames strings provided by the underlying C libraries. Representing flags this way in Perl is an interesting problem, which Glib solves by using some cool overloaded operators. The functions described here actually do the work of those overloaded operators. See the description of the flags operators in the "This Is Now That" section of Glib for more info. METHODS
scalar = $class->new ($a) o $a (scalar) Create a new flags object with given bits. This is for use from a subclass, it's not possible to create a "Glib::Flags" object as such. For example, my $f1 = Glib::ParamFlags->new ('readable'); my $f2 = Glib::ParamFlags->new (['readable','writable']); An object like this can then be used with the overloaded operators. scalar = $a->all ($b, $swap) o $b (scalar) o $swap (scalar) aref = $f->as_arrayref Return the bits of $f as a reference to an array of strings, like ['flagbit1','flagbit2']. This is the overload function for "@{}", ie. arrayizing $f. You can call it directly as a method too. Note that @$f gives the bits as a list, but as_arrayref gives an arrayref. If an arrayref is what you want then the method style somefunc()->as_arrayref can be more readable than [@{somefunc()}]. bool = $f->bool Return 1 if any bits are set in $f, or 0 if none are set. This is the overload for $f in boolean context (like "if", etc). You can call it as a method to get a true/false directly too. integer = $a->eq ($b, $swap) o $b (scalar) o $swap (integer) integer = $a->ge ($b, $swap) o $b (scalar) o $swap (integer) scalar = $a->intersect ($b, $swap) o $b (scalar) o $swap (scalar) integer = $a->ne ($b, $swap) o $b (scalar) o $swap (integer) scalar = $a->sub ($b, $swap) o $b (scalar) o $swap (scalar) scalar = $a->union ($b, $swap) o $b (scalar) o $swap (scalar) scalar = $a->xor ($b, $swap) o $b (scalar) o $swap (scalar) SEE ALSO
Glib COPYRIGHT
Copyright (C) 2003-2011 by the gtk2-perl team. This software is licensed under the LGPL. See Glib for a full notice. perl v5.14.2 2012-05-24 Glib::Flags(3pm)
Man Page