Re: optimization behaviour

2007-05-11 Thread karl wettin
10 maj 2007 kl. 21.29 skrev Yonik Seeley: On 5/10/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: Deleted documents are removed on segment merges (for documents marked as deleted in those segments). Of course, that doesn't have to be the case. It would be a trivial change to merge segments and

Re: optimization behaviour

2007-05-11 Thread Yonik Seeley
On 5/10/07, karl wettin <[EMAIL PROTECTED]> wrote: > Deleted documents are removed on segment merges (for documents marked > as deleted in those segments). > Due to the nature of an inverted index, it's impossible w/o going over > the complete index looking for all references to that docid. Wha

Re: optimization behaviour

2007-05-10 Thread karl wettin
10 maj 2007 kl. 21.28 skrev Yonik Seeley: Deleted documents are removed on segment merges (for documents marked as deleted in those segments). Due to the nature of an inverted index, it's impossible w/o going over the complete index looking for all references to that docid. What about alte

Re: optimization behaviour

2007-05-10 Thread Peter Keegan
Of course, that doesn't have to be the case. It would be a trivial change to merge segments and not remove the deleted docs. That usecase could be useful in conjunction with ParallelReader. If the behavior of deleted docs during merging or optimization ever changes, please make this configurab

Re: optimization behaviour

2007-05-10 Thread Yonik Seeley
On 5/10/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: Deleted documents are removed on segment merges (for documents marked as deleted in those segments). Of course, that doesn't have to be the case. It would be a trivial change to merge segments and not remove the deleted docs. That usecase co

Re: optimization behaviour

2007-05-10 Thread Yonik Seeley
On 5/10/07, karl wettin <[EMAIL PROTECTED]> wrote: I really want to use document numbers as a secondary key in my object storage. If I got it all right, the main problem is deleted documents and optimization. Are there any other issues? Deleted documents are removed on segment merges (for docum

optimization behaviour

2007-05-10 Thread karl wettin
I really want to use document numbers as a secondary key in my object storage. If I got it all right, the main problem is deleted documents and optimization. Are there any other issues? All my tests tells me optimization does this: Legend: action docNum doc.toString() for (int i=0; i<4; i