Re: Implicit Stopping in StandardTokenizer??

2005-06-20 Thread Mike Barry
Max Pfingsthorn wrote: >Hi! > >I've been trying to make an Analyzer which works like the StandardAnalyzer but >without stopping. For some reason though, I still don't get words like "is" or >"a" out of it... I checked with Luke (one doc in one index with the contents >"hello,this,is,a,keyword,h

Re: QueryParser, phrases and stopwords

2005-06-16 Thread Mike Barry
Daniel Naber wrote: >On Thursday 16 June 2005 04:17, Erik Hatcher wrote: > > > >>So we could change StopFilter to put the gaps back in safely now, I >>think. >> >>Thoughts? >> >> > >I personally don't have a problem with this, but shouldn't such a change be >optional? Like a parameter for

Re: QueryParser, phrases and stopwords

2005-06-16 Thread Mike Barry
token = input.next()) ! if (!stopWords.contains(token.termText)) return token; // reached EOS -- return null return null; } Erik Hatcher wrote: > > On Jun 15, 2005, at 12:12 PM, Mike Barry wrote: > >> I have a situation where a query such as

QueryParser, phrases and stopwords

2005-06-15 Thread Mike Barry
I have a situation where a query such as "climate control" is returning documents with the phrase "climate of control". (I'm using QueryParser). After searching, I found the similar issue on the mailing list from Greg Robertson with a patch from Steve Rowe. Looking at the source repository for