Hi all!
A little bit more of exploration:)
After indexing with multiple atomic field values, here is what I get:
indexSearcher.doc(0).getFields("gramm")
stored,indexed,tokenized,termVector,omitNorms
stored,indexed,tokenized,termVector,omitNorms
stored,indexed,tokenized,termVector,omitNorms
stor
Hi again!
Here is my problem in more detail: in addition to indexing, I need the
multi-value field to be stored as-is. And if I pass it into the analyzer as
multiple atomic tokens, it stores only the first of them.
What do I need to do to my custom analyzer to make it store all the atomic
token
Hello!
I have really long document field values. Tokens of these fields are of the
form: word|payload|position_increment. (I need to control position increments
and payload manually.)
I collect these compound tokens for the entire document, then join them with a
'\t', and then pass this string