Re: Stop words filter

2010-06-23 Thread Erick Erickson
On the chance that this is an XY problem (http://people.apache.org/~hossman/#xyproblem), why can't you use StopFilter and PorterStemFilter in your filter chain rather than try to do this yourself? Best Erick On Tue, Jun 22, 2010 at 10:49 PM, Vinicius Carvalho < viniciusccarva...@gmail.com> wrote:

RE: Stop words filter

2010-06-22 Thread Uwe Schindler
m: Vinicius Carvalho [mailto:viniciusccarva...@gmail.com] > Sent: Wednesday, June 23, 2010 4:50 AM > To: java-user@lucene.apache.org > Subject: Stop words filter > > Hello there! I've been using lucene as a Fult Text Search solution for some > time. And although I'm famil

Re: Stop words filter

2010-06-22 Thread Rebecca Watson
i guess you are using lucene 2.9 or below if you're talking about Tokens still... here's some old code i used to use (not sure if i wrote it or grabbed it from online examples - its been a while since i used it!) that grabbed the set of tokens given field name + text to analyse (for any class that

Stop words filter

2010-06-22 Thread Vinicius Carvalho
Hello there! I've been using lucene as a Fult Text Search solution for some time. And although I'm familiar with Analyzers and Stemmers I never used them directly. I'm testing a few experiments on Sentiment Analysis and our implementation needs to perform stemming and stop word removal. I thought