Re: Access next token in a stream

2012-02-09 Thread Damerian
buteSource clones, as in my pseudo-code. Steve -Original Message- From: Damerian [mailto:dameria...@gmail.com] Sent: Thursday, February 09, 2012 5:00 PM To: java-user@lucene.apache.org Subject: Re: Access next token in a stream Στις 9/2/2012 10:51 μμ, ο/η Steven A Rowe έγραψε: Dame

RE: Access next token in a stream

2012-02-09 Thread Steven A Rowe
-Original Message- > From: Damerian [mailto:dameria...@gmail.com] > Sent: Thursday, February 09, 2012 5:00 PM > To: java-user@lucene.apache.org > Subject: Re: Access next token in a stream > > Στις 9/2/2012 10:51 μμ, ο/η Steven A Rowe έγραψε: > > Damerian, > > &

Re: Access next token in a stream

2012-02-09 Thread Damerian
al Message- From: Damerian [mailto:dameria...@gmail.com] Sent: Thursday, February 09, 2012 4:15 PM To: java-user@lucene.apache.org Subject: Re: Access next token in a stream Στις 9/2/2012 8:54 μμ, ο/η Steven A Rowe έγραψε: Hi Damerian, One way to handle your scenario is to hold on to the previous token, an

RE: Access next token in a stream

2012-02-09 Thread Steven A Rowe
gt; Sent: Thursday, February 09, 2012 4:15 PM > To: java-user@lucene.apache.org > Subject: Re: Access next token in a stream > > Στις 9/2/2012 8:54 μμ, ο/η Steven A Rowe έγραψε: > > Hi Damerian, > > > > One way to handle your scenario is to hold on to the previous tok

Re: Access next token in a stream

2012-02-09 Thread Damerian
Στις 9/2/2012 8:54 μμ, ο/η Steven A Rowe έγραψε: Hi Damerian, One way to handle your scenario is to hold on to the previous token, and only emit a token after you reach at least the second token (or at end-of-stream). Your incrementToken() method could look something like: 1. Get current att

RE: Access next token in a stream

2012-02-09 Thread Steven A Rowe
Hi Damerian, One way to handle your scenario is to hold on to the previous token, and only emit a token after you reach at least the second token (or at end-of-stream). Your incrementToken() method could look something like: 1. Get current attributes: input.incrementToken() 2. If previous toke