Lucene 3.4 : shift bug in possibly invalid use of NumericTokenStream

2011-12-16 Thread Thushara Wijeratna
I got this exception while indexing with Lucene 3.4: Exception in thread "Thread-0" java.lang.IllegalArgumentException: Illegal shift value, must be 0..31 at org.apache.lucene.util.NumericUtils.intToPrefixCoded(NumericUtils.java:157) at org.apache.lucene.analysis.NumericTokenStream.incrementToke

Re: Lucene 3.4 : shift bug in possibly invalid use of NumericTokenStream

2011-12-16 Thread Thushara Wijeratna
ey configured? > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -----Original Message- > > From: Thushara Wijeratna [mailto:thu...@gmail.com] > > Sent: Saturday, December 17, 2011 1

Re: Lucene 3.4 : shift bug in possibly invalid use of NumericTokenStream

2011-12-18 Thread Thushara Wijeratna
chindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: Thushara Wijeratna [mailto:thu...@gmail.com] > > Sent: Saturday, December 17, 2011 1:01 AM > > To: j

Re: Lucene 3.4 : shift bug in possibly invalid use of NumericTokenStream

2011-12-18 Thread Thushara Wijeratna
u are > using can never cause such behavior, this is extensively tested. > > ** ** > > Uwe > > ** ** > > - > > Uwe Schindler > > H.-H.-Meier-Allee 63, D-28213 Bremen > > http://www.thetaphi.de > > eMail: u...@th

Re: Lucene 3.4 : shift bug in possibly invalid use of NumericTokenStream

2011-12-19 Thread Thushara Wijeratna
Actually, the a single timestamp field is being used by several threads. Sorry, I missed that, and thanks Peter, Uwe both for the explanations. [In my code snippet, I was trying to simplify so missed this. I'm constructing one timestamp field and passing it to all threads in the ctor.] On Mon, Dec

lucene gosen diff btn jars

2012-03-02 Thread Thushara Wijeratna
I'm testing lucene-gosen for Japanese tokenization and wondering what the differences are between the two jars provided. (ipadic / chaisen)? In my preliminary testing, I'm not seeing any difference in tokenization in these two jars. (the jar with no dictionary did not work, I assume I need to make