Re: Merging indexes & multicore/multithreading

2008-12-02 Thread Michael McCandless
With ConcurrentMergeScheduler, adding all indexes at once to a single IndexWriter will use multiple threads to do the merging, assuming you have enough total segments that need merging (> 2 X mergeFactor will use 2 threads; > 3 X mergeFactor will use 3, etc.; CMS defaults to max 3 merge t

RE: Merging indexes & multicore/multithreading

2008-12-02 Thread Sudarsan, Sithu D.
:[EMAIL PROTECTED] Sent: Tuesday, December 02, 2008 1:17 PM To: java-user@lucene.apache.org Subject: Merging indexes & multicore/multithreading Let's say I have 8 indexes on a 4 core system and I want to merge them (inside a single vm instance). Is it better to do a single merge of all 8,

Merging indexes & multicore/multithreading

2008-12-02 Thread Glen Newton
Let's say I have 8 indexes on a 4 core system and I want to merge them (inside a single vm instance). Is it better to do a single merge of all 8, or to in parallel threads merge in pairs, until there is only a single index left? I guess the question involves how multi-threaded merging is and if it