Re: Query performance in Lucene 4.x

2013-10-02 Thread Desidero
gt; > > > > > On Tue, Oct 1, 2013 at 4:10 PM, Desidero wrote: > > > > > > > Uwe, > > > > > > > > I was using a bounded thread pool. > > > > > > > > I don't know if the problem was the task overload or something

Re: Query performance in Lucene 4.x

2013-10-02 Thread Vitaly Funstein
y of searching a single segment rather than iterating > > over > > > multiple AtomicReaderContexts, but I'd lean toward task overload. I > will > > do > > > some testing tonight to find out for sure. > > > > > > Matt > > >

Re: Query performance in Lucene 4.x

2013-10-02 Thread Desidero
> Uwe Schindler > > H.-H.-Meier-Allee 63, D-28213 Bremen > > http://www.thetaphi.de > > eMail: u...@thetaphi.de > > > > > > > -Original Message- > > > From: Desidero [mailto:desid...@gmail.com] > > > Sent: Tuesday, October 01, 2013

Re: Query performance in Lucene 4.x

2013-10-02 Thread Vitaly Funstein
- > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: Desidero [mailto:desid...@gmail.com] > > Sent: Tuesday, October 01, 2013 11:37 PM > > To: java-use

Re: Query performance in Lucene 4.x

2013-10-02 Thread Desidero
se a bounded thread pool. > > Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: Desidero [mailto:desid...@gmail.com] > > Sent: Tues

Re: Query performance in Lucene 4.x

2013-10-01 Thread Desidero
PM > To: java-user@lucene.apache.org > Subject: Re: Query performance in Lucene 4.x > > For anyone who was wondering, this was actually resolved in a different > thread today. I misread the information in the > IndexSearcher(IndexReader,ExecutorService) constructor documentation - I &

RE: Query performance in Lucene 4.x

2013-10-01 Thread Uwe Schindler
e.apache.org > Subject: Re: Query performance in Lucene 4.x > > For anyone who was wondering, this was actually resolved in a different > thread today. I misread the information in the > IndexSearcher(IndexReader,ExecutorService) constructor documentation - I > was under the impre

Re: Query performance in Lucene 4.x

2013-10-01 Thread Desidero
For anyone who was wondering, this was actually resolved in a different thread today. I misread the information in the IndexSearcher(IndexReader,ExecutorService) constructor documentation - I was under the impression that it was submitting a thread for each index shard (MultiReader wraps 20 shards,

Re: Query performance in Lucene 4.x

2013-09-27 Thread Desidero
Erick, Thank you for responding. I ran tests using both compressed fields and uncompressed fields, and it was significantly slower with uncompressed fields. I looked into the lazy field loading per your suggestion, but we don't get any values from the returned Documents until the result set has b

Re: Query performance in Lucene 4.x

2013-09-27 Thread Erick Erickson
Hmmm, since 4.1, fields have been stored compressed by default. I suppose it's possible that this is a result of compressing/uncompressing. What happens if 1> you enable lazy field loading 2> don't load any fields? FWIW, Erick On Thu, Sep 26, 2013 at 10:55 AM, Desidero wrote: > A quick update:

Re: Query performance in Lucene 4.x

2013-09-26 Thread Desidero
A quick update: In order to confirm that none of the standard migration changes had a negative effect on performance, I ported my Lucene 4.x version back to Lucene 3.6.2 and kept the newer API rather than using the custom ParallelMultiSearcher and other deprecated methods/classes. Performance in