David Smiley created LUCENE-8344:
------------------------------------
Summary: TokenStreamToAutomaton doesn't ignore trailing posInc
when preservePositionIncrements=false
Key: LUCENE-8344
URL: https://issues.apache.org/jira/browse/LUCENE-8344
Project: Lucene - Core
Issue Type: Bug
Components: modules/suggest
Reporter: David Smiley
TokenStreamToAutomaton in Lucene core is used by the AnalyzingSuggester (incl.
FuzzySuggester subclass ) and NRT Document Suggester and soon the
SolrTextTagger. It has a setting {{preservePositionIncrements}} defaulting to
true. If it's set to false (e.g. to ignore stopwords) and if there is a
_trailing_ position increment greater than 1, TS2A will _still_ add position
increments (holes) into the automata even though it was configured not to.
I'm filing this issue separate from LUCENE-8332 where I first found it. The
fix is very simple but I'm concerned about back-compat ramifications so I'm
filing it separately. I'll attach a patch to show the problem.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
