Re: Lucene in clustered environment

2005-08-30 Thread Erik Hatcher
Seema - please stop cross-posting your mails to those three e-mail lists. java-user is the most appropriate list for your posts. Erik On Aug 30, 2005, at 8:07 AM, seema pai wrote: How to use Lucene with File system Indexing on WebSphere application server deployed in a cluster ? On

Re: Lucene in clustered environment

2005-08-30 Thread seema pai
How to use Lucene with File system Indexing on WebSphere application server deployed in a cluster ? On 8/30/05, seema pai <[EMAIL PROTECTED]> wrote: > > Hi > > My site has large database of Television and Movie titles, in English, > Spanish language. The movie data starts from year 1928 ti

Re: Lucene in clustered environment (Tomcat)

2005-06-10 Thread Nader Henein
Considering you have all your servers on one machine a simple memory failure and the whole thing goes south. But you're right, we have an independent Lucene index sitting next to each one of our webservers on each machine, but they are all updated from a central location powered and organized by an

Re: Lucene in clustered environment (Tomcat)

2005-06-07 Thread Ben
Wouldn't it defeat the purpose of clustering if you have a single server to manage a single index? What would happen if this server failed? Cheers, Ben On 6/8/05, Ben <[EMAIL PROTECTED]> wrote: > How about using JavaGroups to notify other nodes in the cluster about > the changes? > > Essentially

Re: Lucene in clustered environment (Tomcat)

2005-06-07 Thread Ben
How about using JavaGroups to notify other nodes in the cluster about the changes? Essentially, each node has the same index stored in a different location. When one node updates/deletes a record, other nodes will get a notification about the changes and update their index accordingly? By using th

Re: Lucene in clustered environment (Tomcat)

2005-06-07 Thread Nader Henein
I realize I've already asked you this question, but do you need 100% real time, because you could run batch them every 2 minutes, and concerning Parallel search, unless you really need it, it's overkill in this case, a communal index will serve you well and will be much easier to maintain. You

Re: Lucene in clustered environment (Tomcat)

2005-06-07 Thread Ben
> When you say your cluster is on a single machine, do you mean that you have > multiple webservers on the same machine all of which search a single Lucene > index? Yes, this is my case. > Do you use Lucene as your persistent store or do you have a DB back there? I use Lucene to search for dat

Re: Lucene in clustered environment (Tomcat)

2005-06-07 Thread Nader Henein
When you say your cluster is on a single machine, do you mean that you have multiple webservers on the same machine all of which search a single Lucene index? Because if that's the case, your solution is simple, as long as you persist to a single DB and then designate one of your servers (or ev

Re: Lucene in clustered environment (Tomcat)

2005-06-07 Thread Ben
My cluster is on a single machine and I am using FS index. I have already integrated Lucene into my web application for use in a non-clustered environment. I don't know what I need to do to make it work in a clustered environment. Thanks, Ben On 6/7/05, Nader Henein <[EMAIL PROTECTED]> wrote: >

Re: Lucene in clustered environment (Tomcat)

2005-06-07 Thread Nader Henein
IMHO, Issues that you need to consider * Atomicity of updates and deletes if you are using multiple indexes on multiple machines (the case if your cluster is over a wide network) * Scheduled indecies to core data comparison and sanitization (intensive) This all depends on what th

Re: Lucene in clustered environment (Tomcat)

2005-06-07 Thread Nader Henein
IMHO, Issues that you need to consider * Atomicity of updates and deletes if you are using multiple indexes on multiple machines (the case if your cluster is over a wide network) * Scheduled indecies to core data comparison and sanitization (intensive) This all depends on what th

Lucene in clustered environment (Tomcat)

2005-06-06 Thread Ben
Hi I would like to use Lucene in a clustered environment, what are the things that I should consider and do? I would like to use the same ordinary index storage for all the nodes in the the cluster, possible? Thanks, Ben - To u