hey scott, this is intentional see the javadoc step 2: http://lucene.apache.org/core/4_0_0/core/org/apache/lucene/analysis/TokenStream.html
simon On Fri, Nov 2, 2012 at 2:07 AM, Scott Smith <ssm...@mainstreamdata.com> wrote: > I was doing some tokenizer/filter analysis attempting to fix a bug I have in > highlighting under 4.0. I was running the displayTokensWithFullDetails code > from LIA2. I would get an exception with a bad index value of -1. > > I fixed the problem by doing a reset() immediately after creating my > TokenStream object. Shouldn't a new TokenStream object be essentially > "reset" when created? This was with SimpleAnalyzer() (since I suspect that > may be relevant). --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
