Re: Performance guarantees and index format

2008-02-08 Thread Doron Cohen
I was once involved in modified a search index implementation (not Lucene) to write posting lists so that they can be traversed (only) in reverse order. Docids were preserved but you got higher IDs first. This was a non-trivial code change. Now the suggestion to (optionally) order merged segments

Re: Performance guarantees and index format

2008-02-07 Thread Chris Hostetter
: I think this would be too messy - currently we can be sure of the simple rule : that documents added to the index get incrementally higher docids, i.e. the : higher the docid the more recent is the document. I think it would be much : simpler to write a FilterIndexReader that simply reverses the

Re: Performance guarantees and index format

2008-02-04 Thread Andrzej Bialecki
Chris Hostetter wrote: : What this issue doesn't discuss is what to do with partial results obtained : when a timeout occurred. As the original poster points out, document lists are : traversed in the order they were added and not the order of their importance, : which introduces a bias to partia

Re: Performance guarantees and index format

2008-02-04 Thread Chris Hostetter
: What this issue doesn't discuss is what to do with partial results obtained : when a timeout occurred. As the original poster points out, document lists are : traversed in the order they were added and not the order of their importance, : which introduces a bias to partial results in that they r

Re: Performance guarantees and index format

2008-01-31 Thread Andrzej Bialecki
Mark Miller wrote: https://issues.apache.org/jira/browse/LUCENE-997 What this issue doesn't discuss is what to do with partial results obtained when a timeout occurred. As the original poster points out, document lists are traversed in the order they were added and not the order of their imp

Re: Performance guarantees and index format

2008-01-31 Thread Mark Miller
https://issues.apache.org/jira/browse/LUCENE-997 - Mark Kyle Maxwell wrote: I'd like to be able to guarantee that a search will finish in (approximately?) N seconds. This seems like a generally applicable goal for the project. It would be nice to not have to worry about malicious or naive u

Performance guarantees and index format

2008-01-31 Thread Kyle Maxwell
I'd like to be able to guarantee that a search will finish in (approximately?) N seconds. This seems like a generally applicable goal for the project. It would be nice to not have to worry about malicious or naive users DOSing a search instance. In some cases, precision can be sacrificed, to see