-
> From:Thomas Matthijs
> Sent: Thu 04-Oct-2012 15:55
> To: java-user@lucene.apache.org
> Subject: Re: Highlighter IOOBE with modified
> HyphenationCompoundWordTokenFilter
>
> And to include the code
>
> On Thu, Oct 4, 2012 at 3:52 PM, Markus Jelsma
> wrote:
> &
And to include the code
On Thu, Oct 4, 2012 at 3:52 PM, Markus Jelsma
wrote:
> I forgot to add that this is with today's build of trunk.
>
> -Original message-
>> From:Markus Jelsma
>> Sent: Thu 04-Oct-2012 15:42
>> To: java-user@lucene.apache.org
&g
I forgot to add that this is with today's build of trunk.
-Original message-
> From:Markus Jelsma
> Sent: Thu 04-Oct-2012 15:42
> To: java-user@lucene.apache.org
> Subject: Highlighter IOOBE with modified HyphenationCompoundWordTokenFilter
>
> Hi,
Hi,
I've modified the HyphenationCompoundWordTokenFilter to emit less subtokens
because the original filter can emit all kinds of subtokens that have a very
different meaning on their own. I've modified it so no overlapping subtokens
are emitted and no subtokens are emitted that can be found wi
