RE: Multiple Indices vs Single Index

2007-09-21 Thread Dino Korah
? -Original Message- From: Nikhil Chhaochharia [mailto:[EMAIL PROTECTED] Sent: 21 September 2007 06:37 To: java-user@lucene.apache.org Subject: Re: Multiple Indices vs Single Index Thanks Grant and Chris for the replies. I am looking at a single index because the 40 index system has

Re: Multiple Indices vs Single Index

2007-09-20 Thread Nikhil Chhaochharia
Message From: Chris Hostetter <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Friday, 21 September, 2007 4:02:38 AM Subject: Re: Multiple Indices vs Single Index : I was wondering if it will be better to just have 1 large index with all : the 40 indices combined. I do not n

Re: Multiple Indices vs Single Index

2007-09-20 Thread Chris Hostetter
: I was wondering if it will be better to just have 1 large index with all : the 40 indices combined. I do not need to do dual-queries and my total : index size (if I create a single index) is about 3.4GB. It will : increase to maximum of 5-6 GB. I am running this on a dedicated machine : w

Re: Multiple Indices vs Single Index

2007-09-20 Thread Grant Ingersoll
profiler also. Thanks for all the suggestions. Regards, Nikhil - Original Message From: Grant Ingersoll <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Thursday, 20 September, 2007 9:25:01 PM Subject: Re: Multiple Indices vs Single Index OK, I thought you meant your index

Re: Multiple Indices vs Single Index

2007-09-20 Thread Nikhil Chhaochharia
, 2007 9:25:01 PM Subject: Re: Multiple Indices vs Single Index OK, I thought you meant your index would have in it the name of the second index and would thus do a two-stage retrieval. At any rate, if you are saying your combined index with all the stored fields is ~3.4 GB I would think it wou

Re: Multiple Indices vs Single Index

2007-09-20 Thread Grant Ingersoll
e: Multiple Indices vs Single Index If I understand correctly, you want to do a two stage retrieval right? That is, look up in the initial index (3.4 GB) and then do a second search on the sub index? Presumably, you have to manage the Searchers, etc. for each of the sub-indexes as well as the big i

Re: Multiple Indices vs Single Index

2007-09-20 Thread Nikhil Chhaochharia
g Sent: Thursday, 20 September, 2007 7:57:21 PM Subject: Re: Multiple Indices vs Single Index If I understand correctly, you want to do a two stage retrieval right? That is, look up in the initial index (3.4 GB) and then do a second search on the sub index? Presumably, you have to manage the Sea

Re: Multiple Indices vs Single Index

2007-09-20 Thread Grant Ingersoll
If I understand correctly, you want to do a two stage retrieval right? That is, look up in the initial index (3.4 GB) and then do a second search on the sub index? Presumably, you have to manage the Searchers, etc. for each of the sub-indexes as well as the big index. This means you have