Re: Basic question about indexing certain words

2009-12-27 Thread syedfa
Thanks very much for such a detailed reply, I didn't realize that there was so much to this subject. I understand the issue a bit better now! Take care. Erick Erickson wrote: > > It depends completely on what analyzer you use. Conceptually, an Analyzer > is composed of a Tokenizer followed by

Re: Basic question about indexing certain words

2009-12-27 Thread Erick Erickson
It depends completely on what analyzer you use. Conceptually, an Analyzer is composed of a Tokenizer followed by any number of Filters. So the input stream is broken up by the Tokenizer, then each token has one or more Filters applied (e.g. LowerCaseFilter, StopWordFilter).. The reason I'm not ans