Re: Indexing documents with multiple field values

2013-10-04 Thread Igor Shalyminov
Hi all! A little bit more of exploration:) After indexing with multiple atomic field values, here is what I get: indexSearcher.doc(0).getFields("gramm") stored,indexed,tokenized,termVector,omitNorms stored,indexed,tokenized,termVector,omitNorms stored,indexed,tokenized,termVector,omitNorms stor

Re: Indexing documents with multiple field values

2013-10-02 Thread Igor Shalyminov
Hi again! Here is my problem in more detail: in addition to indexing, I need the multi-value field to be stored as-is. And if I pass it into the analyzer as multiple atomic tokens, it stores only the first of them. What do I need to do to my custom analyzer to make it store all the atomic token

Indexing documents with multiple field values

2013-09-27 Thread Igor Shalyminov
Hello! I have really long document field values. Tokens of these fields are of the form: word|payload|position_increment. (I need to control position increments and payload manually.) I collect these compound tokens for the entire document, then join them with a '\t', and then pass this string