Thanks very much for such a detailed reply, I didn't realize that there was
so much to this subject. I understand the issue a bit better now!
Take care.
Erick Erickson wrote:
>
> It depends completely on what analyzer you use. Conceptually, an Analyzer
> is composed of a Tokenizer followed by
It depends completely on what analyzer you use. Conceptually, an Analyzer
is composed of a Tokenizer followed by any number of Filters. So the
input stream is broken up by the Tokenizer, then each token has one or
more Filters applied (e.g. LowerCaseFilter, StopWordFilter)..
The reason I'm not ans