Re: Problems with homebrew ParallelWriter

2010-06-24 Thread Justin
Nevermind, it is blocking... public void optimize() throws CorruptIndexException, IOException { optimize(true); } - Original Message From: Justin To: java-user@lucene.apache.org Sent: Thu, June 24, 2010 3:56:17 PM Subject: Re: Problems with homebrew ParallelWriter So is

Re: Problems with homebrew ParallelWriter

2010-06-24 Thread Justin
From: Justin To: java-user@lucene.apache.org Sent: Thu, June 24, 2010 12:12:57 PM Subject: Re: Problems with homebrew ParallelWriter Hi Shai, > Is it synchronized public synchronized void addDocument(Document document) throws CorruptIndexException, IOException { Document docume

Re: Problems with homebrew ParallelWriter

2010-06-24 Thread Justin
04:47 AM Subject: Re: Problems with homebrew ParallelWriter I agree w/ Shai -- from your description it looks like your docs should be in sync (assuming no exceptions, and a serial doc/del stream going in). If you turn on infoStream for all the writers & post the results, we can look for w

Re: Problems with homebrew ParallelWriter

2010-06-24 Thread Justin
ome places to look. Justin - Original Message From: Shai Erera To: java-user@lucene.apache.org Sent: Wed, June 23, 2010 10:48:22 PM Subject: Re: Problems with homebrew ParallelWriter How do you add documents to the index? Is it synchronized (such that basically only one thread can add document

Re: Problems with homebrew ParallelWriter

2010-06-24 Thread Michael McCandless
I agree w/ Shai -- from your description it looks like your docs should be in sync (assuming no exceptions, and a serial doc/del stream going in). If you turn on infoStream for all the writers & post the results, we can look for where they diverge... Mike On Wed, Jun 23, 2010 at 11:48 PM, Shai E

Re: Problems with homebrew ParallelWriter

2010-06-23 Thread Shai Erera
How do you add documents to the index? Is it synchronized (such that basically only one thread can add documents at a time)? The same goes for removing documents as well. Also, did you encounter any exceptions during the run - if say an addDoc fails on one of the slices, then you need to revert th