On the chance that this is an XY problem
(http://people.apache.org/~hossman/#xyproblem),
why can't you use StopFilter and PorterStemFilter in
your filter chain rather than try to do this yourself?
Best
Erick
On Tue, Jun 22, 2010 at 10:49 PM, Vinicius Carvalho <
viniciusccarva...@gmail.com> wrote:
Hi Vinicius,
You should read the Package-Level Docs:
http://lucene.apache.org/java/3_0_2/api/all/org/apache/lucene/analysis/packa
ge-summary.html
To get the Token attributes, you have to add Attributes to your TokenStream
using addAttribute() and then you have easy access to the various attribute
i guess you are using lucene 2.9 or below if you're talking about
Tokens still...
here's some old code i used to use (not sure if i wrote it or grabbed it from
online examples - its been a while since i used it!)
that grabbed the set of tokens given field name +
text to analyse (for any class that
