hey scott,

this is intentional see the javadoc step 2:
http://lucene.apache.org/core/4_0_0/core/org/apache/lucene/analysis/TokenStream.html

simon

On Fri, Nov 2, 2012 at 2:07 AM, Scott Smith <ssm...@mainstreamdata.com> wrote:
> I was doing some tokenizer/filter analysis attempting to fix a bug I have in 
> highlighting under 4.0.  I was running the displayTokensWithFullDetails code 
> from LIA2.  I would get an exception with a bad index value of -1.
>
> I fixed the problem by doing a reset() immediately after creating my 
> TokenStream object.  Shouldn't a new TokenStream object be essentially 
> "reset" when created?  This was with SimpleAnalyzer() (since I suspect that 
> may be relevant).

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org

Reply via email to