RE: Possible issue with Tokenizer in lucene-analyzers-common-4.6.1

2014-03-20 Thread Uwe Schindler
e.apache.org > Subject: Re: Possible issue with Tokenizer in lucene-analyzers-common-4.6.1 > > Thanks Uwe. It worked. > > > > > On Thu, Mar 20, 2014 at 3:28 PM, Uwe Schindler wrote: > > > Hi, > > > > the IllegalStateException tells you what'

Re: Possible issue with Tokenizer in lucene-analyzers-common-4.6.1

2014-03-20 Thread Joe Wong
hi.de > > > > -Original Message- > > From: Joe Wong [mailto:jw...@adacado.com] > > Sent: Thursday, March 20, 2014 11:13 PM > > To: java-user@lucene.apache.org > > Subject: Re: Possible issue with Tokenizer in > lucene-analyzers-common-4.6.1 > >

RE: Possible issue with Tokenizer in lucene-analyzers-common-4.6.1

2014-03-20 Thread Uwe Schindler
ler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Joe Wong [mailto:jw...@adacado.com] > Sent: Thursday, March 20, 2014 11:13 PM > To: java-user@lucene.apache.org > Subject: Re: Possible issue with Tokenizer in

Re: Possible issue with Tokenizer in lucene-analyzers-common-4.6.1

2014-03-20 Thread Joe Wong
Hi Uwe, Thanks for the reply. I'm not familiar with the usage of Lucene so any help would be appreciated. In our test we are executing several consecutive stemming operations (exception is thrown when the second stemmer.stem() method is called). In the code, see below, it does call the reset() me

RE: Possible issue with Tokenizer in lucene-analyzers-common-4.6.1

2014-03-20 Thread Uwe Schindler
Hi Joe, in Lucene 4.6, the TokenStream/Tokenizer APIs got some additional state machine checks to ensure that consumers and subclasses of those abstract interfaces are implemented in a correct way - they are not easy to understand, because they are implemented in that way to ensure they don't a