: This is index of 1, is has index 2, an has index 3 Example has index 4.
: What I have is the actual "character position" in the original text. "This"
in that case, you'll have to do a while loop over next() calls and check
the startOffset (or endOffset) of each untill you find the one you are
I thought that went to the "index" of the token. I may not understand it
completely but this is how I currently view the TokenStream
For example if my text was the following:
This is an Example
This is index of 1, is has index 2, an has index 3 Example has index 4.
What I have is the actual "c
: I never got a response to this and thought maybe I was too wordy.
:
: I'm wondering if there's a way where given a position in the original text
: you can retrieve the token index that is nearest to that position using the
: StandardToken/StandardTokenizer classes?
i may not be understanding the
Hi,
I never got a response to this and thought maybe I was too wordy.
I'm wondering if there's a way where given a position in the original text
you can retrieve the token index that is nearest to that position using the
StandardToken/StandardTokenizer classes?
--JP
On 7/3/07, John Paul Sond
Hi,
I was wondering if it's possible to get the token offset based of the
position in the original text.
My problem is I'm working on my own "Snippet Generator" and I'm giving a
token index (call it t) as input and need to make a snippet of the original
text. I want the Snippet to be some numbe
