Re: shared instance of IndexWriter doesn't improve proformance

2012-01-11 Thread Michael McCandless
I think it's hard to compare the results here? In test 1 (single IW shared across threads) you end up with one index. In test 2 (private IW per thread) you end up with N indexes, which to be "fair" need to be merged down into one index (eg with .addIndexes)? Or seen another way, test 1 should ha

Re: shared instance of IndexWriter doesn't improve proformance

2012-01-11 Thread Ian Lea
Contention. There is always a limit somewhere, I/O, CPU, memory, locks, ... Use your OS tools or java profiling/logging/debugging to find out what is going on - or just go with what works for you. If you're doing something like loading data read from a database, it is my experience that the bott