Re: Tokenization question

2007-09-13 Thread Mike Klaas
On 13-Sep-07, at 12:37 PM, Dan Luria wrote: What I do is Doc1 = source_doc Doc2 = new Document() foreach (field f in doc1.getfields) { Doc2.Add(new Field(doc1.getField(key), doc1.getField(value)); } but when i pull the fields from Doc1, i never get the tokenized field.. it just doesnt appea

Re: Tokenization question

2007-09-13 Thread Dan Luria
What I do is Doc1 = source_doc Doc2 = new Document() foreach (field f in doc1.getfields) { Doc2.Add(new Field(doc1.getField(key), doc1.getField(value)); } but when i pull the fields from Doc1, i never get the tokenized field.. it just doesnt appear. so my question is -- i can see that field in

Re: Tokenization question

2007-09-13 Thread Erick Erickson
If I'm understanding you correctly, the answer is... maybe, kinda. Take a look at some of the Luke code. That tries to reconstruct document fields from the index, but it's lossy. So it depends upon what kind of fidelity you need. Erick On 9/12/07, Dan Luria <[EMAIL PROTECTED]> wrote: > > If I hav

Tokenization question

2007-09-12 Thread Dan Luria
If I have a tokenized unstored field in a document, and I want to transfer the document to another index, is it possible to carry of the tokenization with terms? - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands,