Re: Concurrent query benchmarks, with 1,2,4,8 readers

2008-06-25 Thread Grant Ingersoll
sense. --Regards, Rakesh S Date: Fri, 13 Jun 2008 12:51:51 -0400 From: [EMAIL PROTECTED] To: java-user@lucene.apache.org Subject: Re: Concurrent query benchmarks, with 1,2,4,8 readers Lutan, Yes, no problem. I am away at a conference next week but plan to release the code the following week

RE: Concurrent query benchmarks, with 1,2,4,8 readers

2008-06-24 Thread Rakesh Shete
Hi Glen, Is your source code available? I would like to have a look at it and check if whatever I have tried makes sense. --Regards, Rakesh S > Date: Fri, 13 Jun 2008 12:51:51 -0400 > From: [EMAIL PROTECTED] > To: java-user@lucene.apache.org > Subject: Re: Concurrent query benc

Re: Concurrent query benchmarks, with 1,2,4,8 readers

2008-06-16 Thread Grant Ingersoll
Also note, there is the contrib/benchmark source in Lucene that allows one to do many of these tests in a "standard" way, such that the results are easily reproducible. Do you actually have a situation where you would ever see 8K threads? Or even 4k? Or was this just for the purposes of t

RE: Concurrent query benchmarks, with 1,2,4,8 readers

2008-06-13 Thread lutan
TO : Glen Newton Thank you very much! I am so glad to learn it. > Date: Fri, 13 Jun 2008 12:51:51 -0400> From: [EMAIL PROTECTED]> To: > java-user@lucene.apache.org> Subject: Re: Concurrent query benchmarks, with > 1,2,4,8 readers> > Lutan,> > Yes, no problem.

Re: Concurrent query benchmarks, with 1,2,4,8 readers

2008-06-13 Thread Glen Newton
Lutan, Yes, no problem. I am away at a conference next week but plan to release the code the following week. Is this OK for you? thanks, Glen 2008/6/13 lutan <[EMAIL PROTECTED]>: > > TO: Glen Newton Could I get your test code or code architecture for study. > I have try to using java.util.concu

RE: Concurrent query benchmarks, with 1,2,4,8 readers

2008-06-13 Thread lutan
TO: Glen Newton Could I get your test code or code architecture for study. I have try to using java.util.concurrent package( like ArrayBlockingQueue ThreadPoolExecutor;) with lucene,but it is no successful.I don't know how to design. Thanks ! my emial: [EMAIL PROTECTED]

Re: Concurrent query benchmarks, with 1,2,4,8 readers

2008-06-11 Thread Glen Newton
Hi Otis, Thanks for the feedback. 2008/6/11 Otis Gospodnetic <[EMAIL PROTECTED]>: > Hi Glen, > > Aha, good to see the benefit of multiple IndexReaders/Searchers so clearly. > Makes me think we'll want to add a config setting for this in Solr... :) Until then, you might want to use: Runtime.ava

Re: Concurrent query benchmarks, with 1,2,4,8 readers

2008-06-11 Thread Otis Gospodnetic
Hi Glen, Aha, good to see the benefit of multiple IndexReaders/Searchers so clearly. Makes me think we'll want to add a config setting for this in Solr... :) As for why 4 is the best choice, I think it's because of those 4 cores that you've got. My guess is that you'll see slightly better per

Re: Concurrent query benchmarks

2008-06-10 Thread Glen Newton
Thanks for the positive feedback. :-) Yes, right now the benchmark only uses one IndexSearcher for all threads, but I have completed an extension that allows you to either 1) have multiple searchers for the same index; or 2) have multiple indexes (copies of one another) with a single searcher per

Re: Concurrent query benchmarks

2008-06-10 Thread Chris Lu
Good work! I would like to see how it performs with several index reader instances, which is said to increase concurrency. -- Chris Lu - Instant Scalable Full-Text Search On Any Database/Application site: http://www.dbsight.net demo: http://search.dbsight.com Lucene Datab

Re: Concurrent query benchmarks

2008-06-10 Thread Glen Newton
2008/6/9 Otis Gospodnetic <[EMAIL PROTECTED]>: > Hi Glen, > > Thanks for sharing. Does your benchmarking tool build on top of > contrib/benchmark? (not sure if that one lets you specify the number of > concurrent threads -- if it does not, perhaps this is an opportunity to add > this functional

Re: Concurrent query benchmarks

2008-06-09 Thread Doron Cohen
On Tue, Jun 10, 2008 at 3:50 AM, Otis Gospodnetic < [EMAIL PROTECTED]> wrote: > Hi Glen, > > Thanks for sharing. Does your benchmarking tool build on top of > contrib/benchmark? (not sure if that one lets you specify the number of > concurrent threads -- if it does not, perhaps this is an opportu

Re: Concurrent query benchmarks

2008-06-09 Thread Otis Gospodnetic
Hi Glen, Thanks for sharing. Does your benchmarking tool build on top of contrib/benchmark? (not sure if that one lets you specify the number of concurrent threads -- if it does not, perhaps this is an opportunity to add this functionality). I couldn't find info about the index format (compou