Re: One problem of using the lucene

2006-01-17 Thread jason
Ok, i will try it. On 1/17/06, Erik Hatcher <[EMAIL PROTECTED]> wrote: > > > On Jan 17, 2006, at 5:58 AM, jason wrote: > > I have test the snowballFilter and it does not stem the term > > "support". It > > means the term "support" should be in all the papers. However, i > > add the > > synonymF

Re: One problem of using the lucene

2006-01-17 Thread Erik Hatcher
On Jan 17, 2006, at 5:58 AM, jason wrote: I have test the snowballFilter and it does not stem the term "support". It means the term "support" should be in all the papers. However, i add the synonymFilter, the "support" is missing. Two very valuable troubleshooting techniques: 1) Run yo

Re: One problem of using the lucene

2006-01-17 Thread jason
hi, thx for your replies. I have test the snowballFilter and it does not stem the term "support". It means the term "support" should be in all the papers. However, i add the synonymFilter, the "support" is missing. I think i have to read the lucene source code again. yours truly Jiang Xing On

Re: One problem of using the lucene

2006-01-17 Thread Erik Hatcher
On Jan 17, 2006, at 12:14 AM, jason wrote: It is adding tokens into the same position as the original token. And then, I used the QueryParser for searching and the snowball analyzer for parsing. Ok, so you're only using the SynonymAnalyzer for indexing, and the SnowballAnalyzer for QueryP

Re: One problem of using the lucene

2006-01-16 Thread jason
Hi, the following code is the SynonymFilter i wrote. import org.apache.lucene.analysis.*; import java.io.*; import java.util.*; /** * @author JIANG XING * * Jan 15, 2006 */ public class SynonymFilter extends TokenFilter { public static final String TOKEN_TYPE_SYNONYM = "SYNONYM";

Re: One problem of using the lucene

2006-01-16 Thread Erik Hatcher
Could you share the details of your SynonymFilter? Is it adding tokens into the same position as the original tokens (position increment of 0)? Are you using QueryParser for searching? If so, try TermQuery to eliminate the parser's analysis from the picture for the time being while trou

One problem of using the lucene

2006-01-16 Thread jason
Hi, I got a problem of using the lucene. I write a SynonymFilter which can add synonyms from the WordNet. Meanwhile, i used the SnowballFilter for term stemming. However, i got a problem when combining the two fiters. For instance, i got 17 documents containing the Term "support" and the follo