Awesome, thanks for bringing closure Vitaly.
Mike McCandless
http://blog.mikemccandless.com
On Mon, Jun 4, 2012 at 3:10 PM, Vitaly Funstein wrote:
> Thanks for the tip, Mike. After changing the three calls
>
> IndexWriter.commit();
>
>
>
> IndexWriter.maybeMerge();
> IndexWriter.waitForMerges
Thanks for the tip, Mike. After changing the three calls
IndexWriter.commit();
IndexWriter.maybeMerge();
IndexWriter.waitForMerges();
to simply calling IndexWriter.close(true) the disk size and run time are
now very close to the case of parallel segment merges.
On Sat, Jun 2, 2012 at 6:43 AM,
On Fri, Jun 1, 2012 at 8:09 PM, Vitaly Funstein wrote:
> Yes, I am only calling IndexWriter.addDocument()
OK.
> Interestingly, relative performance of either approach seems to greatly
> depend on the number of documents per index. In both types of runs, I used
> 10 writer threads, each writing d
Yes, I am only calling IndexWriter.addDocument()
Interestingly, relative performance of either approach seems to greatly
depend on the number of documents per index. In both types of runs, I used
10 writer threads, each writing documents with the same set of fields (but
random values), into its ow
64% greater index size when you merge at the end is odd.
Can you post the ls -l output of the final index in both cases?
Are you only adding (not deleting) docs?
This is perfectly valid to do... but I'm surprised you see the two
approaches taking about the same time. I would expect letting Luce
Any takers on this one or is my inquiry a bit too broad? I can post my
test code if that helps...
On Tue, May 29, 2012 at 6:42 PM, Vitaly Funstein wrote:
> Hello,
>
> I am trying to optimize the process of "warming up" an index prior to
> using the search subsystem, i.e. it is guaranteed that no
Hello,
I am trying to optimize the process of "warming up" an index prior to
using the search subsystem, i.e. it is guaranteed that no other writes
or searches can take place in parallel with with the warmup. To that
end, I have been toying with the idea of turning off segment merging
altogether u
