Re: Very large number of indices in distributed environment

2005-08-14 Thread Rasik Pandey
> A big index is slow to merge, slow to search, and as you mentioned, > it's slow to sync. An 1G index took me several hours to merge on a P3 > 1GHz 512MRam Don't forget "slow to back-up". -- Regards, Rus - To unsubscribe, e-ma

Re: Very large number of indices in distributed environment

2005-08-04 Thread Otis Gospodnetic
Hi Benjamin, I don't know what exactly your application is doing, but option 2) sounds the most manageable to me. Otis --- Benjamin Reitzammer <[EMAIL PROTECTED]> wrote: > Hi, > we are in the process of planning a search feature of a product and > we > are having quite a hard time figuring out

Re: Very large number of indices in distributed environment

2005-08-04 Thread Ian Lea
In my experience, searching a read only index mounted via NFS is fine. The NFS related issues are with locking. I'd agree with Chris that you should try to avoid very big indexes. -- Ian. On 04/08/05, Chris Lu <[EMAIL PROTECTED]> wrote: > A big index is slow to merge, slow to search, and as yo

Re: Very large number of indices in distributed environment

2005-08-04 Thread Chris Lu
A big index is slow to merge, slow to search, and as you mentioned, it's slow to sync. An 1G index took me several hours to merge on a P3 1GHz 512MRam. Mounting Lucene on NFS is also a "No GO". I feel you choice 2 may be feasible, although complicated. That's your job, right. :) BTW: I guess your