You're going to want to change your TokenFilter so that it emits the split
pieces tokens immediately after the original token and with a
positionIncrement of "0" .. don't buffer then up and wait for the entire
stream to finish first.
it true order of the tokens in the tokenstream and the posit
Hi, I have written a TokenFilter which breaks up words with internal dot
characters and adds the whole word plus the pieces as tokens in the stream. I
am using that TokenFilter with the StandardAnalyzer to index my documents. Then
I do searches using the StandardAnalyzer. Everything is working g
