Re: ParalleReader and synchronization between indexes

2008-05-01 Thread Rajesh parab
-- Original Message > > From: Rajesh parab <[EMAIL PROTECTED]> > > To: java-user@lucene.apache.org > > Sent: Thursday, May 1, 2008 6:55:00 PM > > Subject: Re: ParalleReader and synchronization > between indexes > > > > Thanks Yonik. > >

Re: ParalleReader and synchronization between indexes

2008-05-01 Thread Otis Gospodnetic
gt; From: Rajesh parab <[EMAIL PROTECTED]> > To: java-user@lucene.apache.org > Sent: Thursday, May 1, 2008 6:55:00 PM > Subject: Re: ParalleReader and synchronization between indexes > > Thanks Yonik. > > So, if rebuilding the second index is not an option > due to large no

Re: ParalleReader and synchronization between indexes

2008-05-01 Thread Rajesh parab
Thanks Yonik. So, if rebuilding the second index is not an option due to large no of documents, then ParallelReader will not work :-( And I believe there is no other way than parallelReader to search across multiple indexes that contain related data. Is there any other alternative? I think, Multi

Re: ParalleReader and synchronization between indexes

2008-05-01 Thread Yonik Seeley
On Wed, Apr 30, 2008 at 10:52 PM, Rajesh parab <[EMAIL PROTECTED]> wrote: > Can we somehow keep > internal document id same after updating (i.e. delete > and re-insert) index document? No. ParallelReader is not a general solution, it's an expert-level solution that leaves the task of keeping t

Re: ParalleReader and synchronization between indexes

2008-04-30 Thread Rajesh parab
ttp://sematext.com/ -- Lucene - Solr - > Nutch > > - Original Message > > From: Grant Ingersoll <[EMAIL PROTECTED]> > > To: java-user@lucene.apache.org > > Sent: Wednesday, April 30, 2008 5:48:33 PM > > Subject: Re: ParalleReader and synchronization >

Re: ParalleReader and synchronization between indexes

2008-04-30 Thread Otis Gospodnetic
e you have big+small with docIDs in sync. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Grant Ingersoll <[EMAIL PROTECTED]> > To: java-user@lucene.apache.org > Sent: Wednesday, April 30, 2008 5:48:33 PM > Subject: Re: Paral

Re: ParalleReader and synchronization between indexes

2008-04-30 Thread Grant Ingersoll
Rajesh, You are asking a fairly complicated question on a seldom used piece of functionality. Constantly pinging the list is just making it less likely that someone will respond with an answer. The likelihood that the 1 person who understand that code (and trust me, it really is likely

Re: ParalleReader and synchronization between indexes

2008-04-30 Thread Rajesh parab
Hi Guys, Any comments on this? I was looking into Lucene archive and came across this thread what asks the same question. http://www.gossamer-threads.com/lists/lucene/java-user/50477?search_string=parallelreader;#50477 Any pointers will be helpful. Regards, Rajesh --- Rajesh parab <[EMAIL PRO

Re: ParalleReader and synchronization between indexes

2008-04-29 Thread Rajesh parab
Hi All, Any suggestions/comments on my questions in this thread will be really helpful. We are planning to use Lucene indexes throughout the application and exploring possibilites of partitioning data between multiple indexes. Regards, Rajesh --- Rajesh parab <[EMAIL PROTECTED]> wrote: > Hi, >

ParalleReader and synchronization between indexes

2008-04-29 Thread Rajesh parab
Hi, This is from javadoc of ParallelReader: == An IndexReader which reads multiple, parallel indexes. Each index added must have the same number of documents, but typically each contains different fields. Each document contains the union of the