Re: Merging two tokenized fields

2009-02-27 Thread liat oren
Thanks for your answer - I will store both texts (I have my own objects' ids that i use to identify the documents) and will index the text after the merge. Thank you, Liat 2009/2/26 Erick Erickson > Reconstructing a field from an index is > 1> slow > 2> lossy (what about stemmed words? stopword

Re: Merging two tokenized fields

2009-02-26 Thread Erick Erickson
Reconstructing a field from an index is 1> slow 2> lossy (what about stemmed words? stopwords? ) UNLESS you have stored the data (Field.Store.YES/COMPRESS), in which case you can just get the field from each index and put it in the new one. Tokenization has little to do with this although you coul

Merging two tokenized fields

2009-02-26 Thread liat oren
Hi, I have two indexes, each has a tokenized field and I would like to combine them both into one field in a new index. How can it be done? (Is it a good approach or is it better to hold them as untokenized text and only when I create the new index, then to tokenize it?) Many thanks, Liat

Merging two tokenized fields

2009-02-26 Thread liat oren
Hi, I have two indexes, each has a tokenized field and I would like to combine them both into one field in a new index. How can it be done? (Is it a good approach or is it better to hold them as untokenized text and only when I create the new index, then to tokenize it?) Many thanks, Liat