using DisjunctionMaxQuery

2007-02-11 Thread Mekin Maheshwari
I am trying to use org.apache.lucene.search.DisjunctionMaxQuery First, a quick check on how to use it. I tried looking for javadocs, and the mailing list archive, but could not find much. Here is what I am doing : //finalquery is a boolean query, that has a lot of field specific sub-queries, eac

Re: about merge factor

2007-02-11 Thread Mark Miller
Found a mistake in my reponse...when I was talking about max merge docs, I meant max buffered docs. If your going to optimize anyway, the key setting appears to be max buffered docs, and I have yet to see the merge factor affect anything (again, only if you optimize). Oddly, performance seems t

Re: about merge factor

2007-02-11 Thread Grant Ingersoll
You may find contrib/Benchmark useful in your testing. Doron Cohen has added a nice framework for scripting benchmarking tests. -Grant On Feb 11, 2007, at 12:14 PM, Mark Miller wrote: Not sensible at all. First, a merge above something like 90 most likely never makes since. Second, I have

Re: about merge factor

2007-02-11 Thread Mark Miller
Not sensible at all. First, a merge above something like 90 most likely never makes since. Second, I have done some testing and my results show that if you optimize the index after loading, the merge factor really doesn't matter so keep it at 10 (I never used a max merge docs below 50. 100 work

RE: about merge factor

2007-02-11 Thread Damien McCarthy
Hi Maureen, If you are attempting to tune the indexing have a read of http://www.onjava.com/pub/a/onjava/2003/03/05/lucene.html?page=2 . Otis has some excellent comparisons and explanations of the different optimization strategies available. D. -Original Message- From: maureen tanuwidj

about merge factor

2007-02-11 Thread maureen tanuwidjaja
Hi all, I just wondering wheter is it sensible and possible if I have 660,000 documents to be indexed,I set the merge factor to 660,000 instead of the default value 10 (...and this means no merge while indexing) and later after closing the index,I use the IndexWriter to optimize/merge t