Re: Merging two tokenized fields

2009-02-27 Thread liat oren
Thanks for your answer - I will store both texts (I have my own objects' ids that i use to identify the documents) and will index the text after the merge. Thank you, Liat 2009/2/26 Erick Erickson > Reconstructing a field from an index is > 1> slow > 2> lossy (what about stemmed words? stopword

Re: Merging two tokenized fields

2009-02-26 Thread Erick Erickson
Reconstructing a field from an index is 1> slow 2> lossy (what about stemmed words? stopwords? ) UNLESS you have stored the data (Field.Store.YES/COMPRESS), in which case you can just get the field from each index and put it in the new one. Tokenization has little to do with this although you coul