Serving remote lucene client - RMI vs HTTP

Hi Everyone, We are using lucene,nutch and spring framework to create a specialized search engine. Due to growing traffic we are trying to scale. By doing some tests we found out that the bottle neck was lucene search. We used some heavy traffic simulation and logged the time taken by each portio

Re: Serving remote lucene client - RMI vs HTTP

Hi Everyone, We are using lucene,nutch and spring framework to create a specialized search engine. Due to growing traffic we are trying to scale. By doing some tests we found out that the bottle neck was lucene search. We used some heavy traffic simulation and logged the time taken by each portio

Re: Serving remote lucene client - RMI vs HTTP

Hi Kumar, I am also interested in this question. I have used simple HTTP POST/GET request with open search,and it requires about extra 15ms for transferring search results between two machines.And want to know whether RMI can give a better performance. Thanks -Qi - Original Message -

Re: Serving remote lucene client - RMI vs HTTP

Hi Kumar, I am curious about where the bulk of time was spent in Lucene. I am not doubting your numbers or analysis, just want to know if there was anything that could be improved in Lucene and make sure you are solidly in need of going to multiple machines as it adds an extra level of c

Re: Serving remote lucene client - RMI vs HTTP

Hi EVeryone, Thank you all for your replies. And reply to your questions Grant: We have more than 3 Million document in our index. We get more than 150,000 searches (queries) per day. We expect this no to go up. This count only includes actual user search and doesn't include robot searches and o

Re: search through all fields

On 7/14/07, Grant Ingersoll <[EMAIL PROTECTED]> wrote: I think he means index all your different fields into a single field named "all". Not sure what makes it special, it is just like any other field. but that really impossible ! because I have near millions records to be indexed so this j

Re: Serving remote lucene client - RMI vs HTTP

: And our final queries sent to lucene are quite complicated. This is because : we need to confirm to a lot of criteria (some are set by users and some are : internal logics). I don't think we can simplify our queries. in my experience, your queries can always be made simpler by making your index