Re: Two-pass TokenFilter

2014-08-24 Thread Christian Beil
Hi Ahmet, Sorry, I wasn't very clear. I need a TokenFilter that filters/skips some tokens, just like FilteringTokenFilter. To determine which tokens to filter, I first need to know all tokens. Therefore I need to go through all tokens twice. I implemented an TwoPassTokenFilter that is very simila

Re: Two-pass TokenFilter

2014-08-24 Thread Ahmet Arslan
Hi, Can you elaborate more, what do you mean by "I need to know all tokens inĀ  advance." Ahmet On Wednesday, August 20, 2014 6:48 PM, Christian Beil wrote: Hey guys, I need a TokenFilter that filters some tokens like the FilteringTokenFilter. The problem is, in order to do the filtering I ne