RE: Clustering Lucene with 40 Servers

2007-01-05 Thread Steve Harris
ED] Sent: Wednesday, December 27, 2006 7:57 AM To: java-user@lucene.apache.org Subject: Clustering Lucene with 40 Servers I'm currently investigating the best ways of clustering Lucene. I've heard of both Solr, Terracotta but do not know how well they scale. Their examples talk of a 4 node cluste

Re: Clustering Lucene with 40 Servers

2007-01-02 Thread Peter W.
Hello, Don't have any of the scalability requirements mentioned in this thread but the problem is an interesting one. Lucene needs a connection pool equivalent IMHO or a best practices method for load balancing. Opening, locking, reading and writing to remote indexes over RMI seems good o

Re: Clustering Lucene with 40 Servers

2007-01-02 Thread Otis Gospodnetic
s? ...) before others can make useful suggestions. Otis - Original Message From: Adam Fleming <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Thursday, December 28, 2006 2:33:37 AM Subject: RE: Clustering Lucene with 40 Servers Hello, I saw that Doug Cutting had an int

Re: Clustering Lucene with 40 Servers

2006-12-28 Thread markharw00d
Not quite yet gone up to this scale but here are some points for consideration based on a smaller scale system I have in production that may be of interest: By clustering I presume you are only talking about replication. When we talk about scaling and using multiple machines we need to think

Re: Clustering Lucene with 40 Servers

2006-12-28 Thread Yonik Seeley
On 12/28/06, Adam Fleming <[EMAIL PROTECTED]> wrote: I saw that Doug Cutting had an interesting solution for his Technorati website: http://www.mail-archive.com/lucene-user@jakarta.apache.org/msg12709.html It sounds like it's a single-writer, many readers type of system, but quite robust and ef

Re[2]: Clustering Lucene with 40 Servers

2006-12-28 Thread Sven Duzont
-- >> Date: Wed, 27 Dec 2006 10:46:47 -0800 >> From: [EMAIL PROTECTED] >> To: java-user@lucene.apache.org >> Subject: Re: Clustering Lucene with 40 Servers >> >> Some quick questions/points: >> >> What is the update rate? >> >

RE: Clustering Lucene with 40 Servers

2006-12-27 Thread Adam Fleming
Adam > Date: Wed, 27 Dec 2006 10:46:47 -0800 > From: [EMAIL PROTECTED] > To: java-user@lucene.apache.org > Subject: Re: Clustering Lucene with 40 Servers > > Some quick questions/points: > > What is the update rate? > > The number of nod

Re: Clustering Lucene with 40 Servers

2006-12-27 Thread Steve Harris
etc crashing the servers thereafter. -- View this message in context: http://www.nabble.com/Clustering-Lucene-with-40-Servers-tf2886546.html#a8064135 Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To uns

Re: Clustering Lucene with 40 Servers

2006-12-27 Thread Chris Lu
mber 27, 2006 7:57 AM > To: java-user@lucene.apache.org > Subject: Clustering Lucene with 40 Servers > > > I'm currently investigating the best ways of clustering Lucene. > I've heard of both Solr, Terracotta but do not know how well they scale. > Their examples talk of a 4 nod

Re: Clustering Lucene with 40 Servers

2006-12-27 Thread Levent Bayindir
this seems naïve (I am new to Lucene), but why not keep one copy of the Lucene index on a NAS and have it shared by all servers? -Original Message- From: Biggy [mailto:[EMAIL PROTECTED] Sent: Wednesday, December 27, 2006 7:57 AM To: java-user@lucene.apache.org Subject: Clustering Luce

RE: Clustering Lucene with 40 Servers

2006-12-27 Thread Biggy
AS and have it shared by all servers? > > -Original Message- > From: Biggy [mailto:[EMAIL PROTECTED] > Sent: Wednesday, December 27, 2006 7:57 AM > To: java-user@lucene.apache.org > Subject: Clustering Lucene with 40 Servers > > > I'm currently investigat

RE: Clustering Lucene with 40 Servers

2006-12-27 Thread Scott Sellman
: Clustering Lucene with 40 Servers I'm currently investigating the best ways of clustering Lucene. I've heard of both Solr, Terracotta but do not know how well they scale. Their examples talk of a 4 node cluster. This is way too small for my needs. I have 30x JVMs each handling 3 requests/se

Clustering Lucene with 40 Servers

2006-12-27 Thread Biggy
ing-Lucene-with-40-Servers-tf2886546.html#a8064135 Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]