| KinoSearch1::Analysis::Analyzer(3pm) | User Contributed Perl Documentation | KinoSearch1::Analysis::Analyzer(3pm) |
KinoSearch1::Analysis::Analyzer - base class for analyzers
# abstract base class -- you probably want PolyAnalyzer, not this.
In KinoSearch1, an Analyzer is a filter which processes text, transforming it from one form into another. For instance, an analyzer might break up a long text into smaller pieces (Tokenizer), or it might convert text to lowercase (LCNormalizer).
$token_batch = $analyzer->analyze($token_batch);
All Analyzer subclasses provide an "analyze" method. "analyze()" takes a single TokenBatch as input, and it returns a TokenBatch, either the same one (probably transformed in some way), or a new one.
Copyright 2005-2010 Marvin Humphrey
See KinoSearch1 version 1.01.
| 2022-10-20 | perl v5.36.0 |