Re: WordDelimiterGraphFilter does not respect KeywordAttribute

2018-04-22 Thread Michael Sokolov
OK I opened https://issues.apache.org/jira/browse/LUCENE-8265 and will submit a pr soon On Sat, Apr 21, 2018 at 3:56 PM, Michael McCandless < luc...@mikemccandless.com> wrote: > +1 > > Mike > > On Fri, Apr 20, 2018, 9:42 AM Michael Sokolov wrote: > > > I have a use case that generates some token

Re: WordDelimiterGraphFilter does not respect KeywordAttribute

2018-04-21 Thread Michael McCandless
+1 Mike On Fri, Apr 20, 2018, 9:42 AM Michael Sokolov wrote: > I have a use case that generates some tokens containing punctuation > (fractions and other numerical constructs), but I am handling most > punctuation with WordDelimiterGraphFilter, which then decomposes those > tokens into parts an