| Plucene::Analysis::Tokenizer(3pm) | User Contributed Perl Documentation | Plucene::Analysis::Tokenizer(3pm) |
Plucene::Analysis::Tokenizer - base class for tokenizers
my $tokenizer = Plucene::Analysis::Tokenizer::Subclass
->new({ reader => $reader });
This is an abstract base class for tokenizers.
A Tokenizer is a TokenStream whose input is a Reader.
my $tokenizer = Plucene::Analysis::Tokenizer::Subclass
->new({ reader => $reader });
This will create a new tokenizer.
This must be defined in a subclass
Close the input reader.
| 2018-04-02 | perl v5.26.1 |