Re: IndexWriter cache swetspots

2008-05-15 Thread Karl Wettin
15 maj 2008 kl. 09.46 skrev Michael McCandless: Mark Miller wrote: Its been months since i've tested this sort of thing, but from what I remember there is a point where as you go higher, performance starts to very slowly drop. The point was lower than I'd expect, and def created what look

Re: IndexWriter cache swetspots

2008-05-15 Thread Michael McCandless
Mark Miller wrote: Its been months since i've tested this sort of thing, but from what I remember there is a point where as you go higher, performance starts to very slowly drop. The point was lower than I'd expect, and def created what looked like sweet spot settings. This was my recollect

Re: IndexWriter cache swetspots

2008-05-14 Thread Mark Miller
ene - Solr - Nutch > > > - Original Message > > From: Karl Wettin <[EMAIL PROTECTED]> > > To: java-user@lucene.apache.org > > Sent: Wednesday, May 14, 2008 7:41:08 PM > > Subject: IndexWriter cache swetspots > > > > I have an index with seve

Re: IndexWriter cache swetspots

2008-05-14 Thread Otis Gospodnetic
arl Wettin <[EMAIL PROTECTED]> > To: java-user@lucene.apache.org > Sent: Wednesday, May 14, 2008 7:41:08 PM > Subject: IndexWriter cache swetspots > > I have an index with several million documents that each contains > between a few hundred terms and up to about a million terms

IndexWriter cache swetspots

2008-05-14 Thread Karl Wettin
I have an index with several million documents that each contains between a few hundred terms and up to about a million terms. To me it feels like there would be a rather big difference between the swetspot setting for the cache size when adding very large and very small documents. What a