Re: Distributed Lucene Directory

2008-02-01 Thread Cedric Ho
On Feb 1, 2008 9:47 AM, Mark Miller <[EMAIL PROTECTED]> wrote: > > Cedric Ho wrote: > > > > But managing such a set of indexes is not trivial. Especially when > > need to add redundancies for reliability and update frequently. > > > Agreed. Apparently the Solr guys are working on this now. Certainl

Re: Distributed Lucene Directory

2008-01-31 Thread Mark Miller
Cedric Ho wrote: But managing such a set of indexes is not trivial. Especially when need to add redundancies for reliability and update frequently. Agreed. Apparently the Solr guys are working on this now. Certainly not trivial to do right. You might want to check out that work. I want to

Re: Distributed Lucene Directory

2008-01-31 Thread Cedric Ho
Yes, I am aware of the RemoteSearchable and ParallelSearcher. And I am doing something similiar now. i.e. split the index on multiple machines. But managing such a set of indexes is not trivial. Especially when need to add redundancies for reliability and update frequently. I bumped into this a w

Re: Distributed Lucene Directory

2008-01-31 Thread Karl Wettin
31 jan 2008 kl. 09.42 skrev Cedric Ho: I am wondering if there exist any implemenation of org.apache.lucene.store.Directory which can be distributed across multiple machines with comparable performance to a local FSDirectory index, or is such an idea feasible in the first place. By comparable p

Distributed Lucene Directory

2008-01-31 Thread Cedric Ho
Hi all, I am wondering if there exist any implemenation of org.apache.lucene.store.Directory which can be distributed across multiple machines with comparable performance to a local FSDirectory index, or is such an idea feasible in the first place. By comparable performance I mean a 100G index di