Re: Lucene 3.1 search paralelism per segment doubt

2011-10-27 Thread Simon Willnauer
s on a per segment basis when searching. Since >> Lucene 3.1 it can even parallelize on multiple segments. If you optimize >> your index you only have one segment/ >> I'm trying to configure lucene 3.4 to improve my performance as much as >> possible and make the maximum

Re: Lucene 3.1 search paralelism per segment doubt

2011-10-27 Thread Robert Muir
On Mon, Oct 10, 2011 at 7:02 AM, Marc Sturlese wrote: > I've read in another thread > (http://lucene.472066.n3.nabble.com/Indexing-slower-in-trunk-td3059836.html#a3062991) > /Since Lucene 2.9, Lucene works on a per segment basis when searching. Since > Lucene 3.1 it can ev

Lucene 3.1 search paralelism per segment doubt

2011-10-10 Thread Marc Sturlese
I've read in another thread (http://lucene.472066.n3.nabble.com/Indexing-slower-in-trunk-td3059836.html#a3062991) /Since Lucene 2.9, Lucene works on a per segment basis when searching. Since Lucene 3.1 it can even parallelize on multiple segments. If you optimize your index you only hav

Solr/Lucene 3.1 | apache ab benchmark | org.mortbay.jetty.EofException | java.net.SocketException: Broken pipe

2011-05-04 Thread Johannes Goll
Hi, I am running ab, Apache's HTTP server benchmarking tool to evaluate the query performance of a Solr/Lucene 3.1 instance. The test index has 12 million documents. The search returns the first 10 rows of 8 stored fields that match a standard query (q=field:value). The box has 256G RAM a

Re: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-04 Thread Michael McCandless
OK, phew :) Thanks for bringing closure... Mike http://blog.mikemccandless.com On Wed, May 4, 2011 at 6:52 AM, Tomislav Poljak wrote: > Hi, > seems there is a custom impl of MultiPhraseQuery used in the system, > which uses (and maybe misuses) Lucene's MultiPhraseQuery that could be > the reas

Re: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-04 Thread Tomislav Poljak
Hi, seems there is a custom impl of MultiPhraseQuery used in the system, which uses (and maybe misuses) Lucene's MultiPhraseQuery that could be the reason of slowdown. I've tried running sample Lucene's MultiPhraseQuery in an infinite while loop printing out times for every 1000 executions and coul

Re: Why has PerFieldAnalyzerWrapper been made final in Lucene 3.1 ?

2011-05-04 Thread Paul Taylor
On 04/05/2011 07:56, Israel Tsadok wrote: On Tue, May 3, 2011 at 7:03 PM, Paul Taylor > wrote: We subclassed PerFieldAnalyzerWrapper as follows: public class PerFieldEntityAnalyzer extends PerFieldAnalyzerWrapper { public PerFieldEntityAnalyzer(

Re: Why has PerFieldAnalyzerWrapper been made final in Lucene 3.1 ?

2011-05-03 Thread Israel Tsadok
On Tue, May 3, 2011 at 7:03 PM, Paul Taylor wrote: > We subclassed PerFieldAnalyzerWrapper as follows: > > public class PerFieldEntityAnalyzer extends PerFieldAnalyzerWrapper { > >public PerFieldEntityAnalyzer(Class indexFieldClass) { >super(new StandardUnaccentAnalyzer()); > >

Why has PerFieldAnalyzerWrapper been made final in Lucene 3.1 ?

2011-05-03 Thread Paul Taylor
We subclassed PerFieldAnalyzerWrapper as follows: public class PerFieldEntityAnalyzer extends PerFieldAnalyzerWrapper { public PerFieldEntityAnalyzer(Class indexFieldClass) { super(new StandardUnaccentAnalyzer()); for(Object o : EnumSet.allOf(indexFieldClass)) {

Re: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-03 Thread Michael McCandless
On Tue, May 3, 2011 at 7:43 AM, Tomislav Poljak wrote: > Hi, > > 2011/5/3 Michael McCandless : >> I feel like we are back to Basic ;) >> >> If you keep running line 40 over and over on the same memory index, do >> you see a slowdown? > > Yes. I've tested running same query list (~3,5 k queries) on

RE: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-03 Thread Uwe Schindler
> Hi, > > 2011/5/3 Michael McCandless : > > I feel like we are back to Basic ;) > > > > If you keep running line 40 over and over on the same memory index, do > > you see a slowdown? > > Yes. I've tested running same query list (~3,5 k queries) on the same > MemoryIndex instance and after a while

Re: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-03 Thread Tomislav Poljak
mergeSort being used >> in >> MultiPhraseQuery. >> >> Otis >> >> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch >> Lucene ecosystem search :: http://search-lucene.com/ >> >> >> >> - Original Message >>&g

Re: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-03 Thread Michael McCandless
inal Message >> From: Michael McCandless >> To: java-user@lucene.apache.org >> Sent: Mon, May 2, 2011 12:15:40 PM >> Subject: Re: MultiPhraseQuery slowing down over time in Lucene 3.1 >> >> By "slowing down over time" do you mean you use the same ind

Re: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-02 Thread Otis Gospodnetic
Michael McCandless > To: java-user@lucene.apache.org > Sent: Mon, May 2, 2011 12:15:40 PM > Subject: Re: MultiPhraseQuery slowing down over time in Lucene 3.1 > > By "slowing down over time" do you mean you use the same index (no new > docs added) yet running the same M

Re: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-02 Thread Michael McCandless
running tests on both MemoryIndex and RAMDirectory based index > in Lucene 3.1, seems MultiPhraseQueries are slowing down over time > (each iteration of executing the same MultiPhraseQueries on the same > doc, seems to require more and more execution time). Are there any > existing

RE: MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-02 Thread Uwe Schindler
m: Tomislav Poljak [mailto:tpol...@gmail.com] > Sent: Monday, May 02, 2011 6:01 PM > To: java-user@lucene.apache.org > Subject: MultiPhraseQuery slowing down over time in Lucene 3.1 > > Hi, > after running tests on both MemoryIndex and RAMDirectory based index in > Lucene 3

MultiPhraseQuery slowing down over time in Lucene 3.1

2011-05-02 Thread Tomislav Poljak
Hi, after running tests on both MemoryIndex and RAMDirectory based index in Lucene 3.1, seems MultiPhraseQueries are slowing down over time (each iteration of executing the same MultiPhraseQueries on the same doc, seems to require more and more execution time). Are there any existing/known issues

Re: lucene 3.1 contrib packages source code download

2011-04-28 Thread Yiannis Gkoufas
rg.apache.lucene.analysis.* *so that I could use them in lucene 3.1 > > version. > > I have *deprecated version* for the above mentioned package. Please tell > > from where I could get the contrib packages *source code* for

Re: lucene 3.1 contrib packages source code download

2011-04-28 Thread Erick Erickson
.analysis.* *so that I could use them in lucene 3.1 > version. > I have *deprecated version* for the above mentioned package. Please tell > from where I could get the contrib packages *source code* for lucene 3.1. > Is there any official website for tha

Re: lucene 3.1 contrib packages source code download

2011-04-28 Thread Yiannis Gkoufas
so that I could use them in lucene 3.1 > version. > I have *deprecated version* for the above mentioned package. Please tell > from where I could get the contrib packages *source code* for lucene 3.1. > Is there any official website for that? If any please tell. > > :) >

lucene 3.1 contrib packages source code download

2011-04-28 Thread Tanuj Jain
Hi, Can anyone please tell where I could download *packages org.apache.lucene.analysis.* *so that I could use them in lucene 3.1 version. I have *deprecated version* for the above mentioned package. Please tell from where I could get the contrib packages *source code* for lucene 3.1. Is there any

RE: Lucene 3.1

2011-04-05 Thread Steven A Rowe
Hi Tanuj, Can you be more specific? What file did you download? (Lucene 3.1 has three downloadable packages: -src.tar.gz, .tar.gz, and .zip.) What did you expect to find that is not there? (Some examples would help.) Steve > -Original Message- > From: Tanu

Lucene 3.1

2011-04-05 Thread Tanuj Jain
Hi, I have downloaded lucene 3.1 and want to use in my program. I found lot of files that differ/missing from lucene 3.0. Is there any way I could get those files as a whole rather than searching for each file and downloading it.