Re: shared instance of IndexWriter doesn't improve proformance

2012-01-11 Thread Michael McCandless
I think it's hard to compare the results here? In test 1 (single IW shared across threads) you end up with one index. In test 2 (private IW per thread) you end up with N indexes, which to be "fair" need to be merged down into one index (eg with .addIndexes)? Or seen another way, test 1 should ha

Re: shared instance of IndexWriter doesn't improve proformance

2012-01-11 Thread Ian Lea
Contention. There is always a limit somewhere, I/O, CPU, memory, locks, ... Use your OS tools or java profiling/logging/debugging to find out what is going on - or just go with what works for you. If you're doing something like loading data read from a database, it is my experience that the bott

shared instance of IndexWriter doesn't improve proformance

2012-01-10 Thread Cheng
Hi, I use a same instance of writer for multiple threads. It turns out that the time to finish jobs is more than to create a new writer instance in each thread. What would be the possible reasons? Thanks