Re: Flushing Thread

2012-07-21 Thread Simon Willnauer
On Fri, Jul 20, 2012 at 2:43 PM, Simon McDuff wrote: > > Hi Simon W., > See comments below. >> Date: Fri, 20 Jul 2012 11:49:03 +0200> Subject: Re: Flushing Thread >> From: simon.willna...@gmail.com >> To: java-user@lucene.apache.org >> >> hey simon ;

RE: Flushing Thread

2012-07-20 Thread Simon McDuff
Hi Simon W., See comments below. > Date: Fri, 20 Jul 2012 11:49:03 +0200> Subject: Re: Flushing Thread > From: simon.willna...@gmail.com > To: java-user@lucene.apache.org > > hey simon ;) > > > On Fri, Jul 20, 2012 at 2:29 AM, Simon McDuff wrote: > &

Re: Flushing Thread

2012-07-20 Thread Simon Willnauer
as filled up you notify another thread that its time for flush and go out and call commit. You can then over time find out what is the right RAM buffer to saturate IO, don't create too many segments to kill performance due to too many background merges and maximise in memory throughput. simonw

RE: Flushing Thread

2012-07-19 Thread Simon McDuff
eve great performance in multithreaded environment! Thank you Simon M. > Date: Thu, 19 Jul 2012 21:52:19 +0200 > Subject: Re: Flushing Thread > From: simon.willna...@gmail.com > To: java-user@lucene.apache.org > > hey, > > On Thu, Jul 19, 2012 at 7:41 PM, Simon McDuff wrote: >

Re: Flushing Thread

2012-07-19 Thread Simon Willnauer
you have many deletes then pull a reader without applying deletes. simon > > Do I understand correctly ? Did I miss something ? > > Simon > >> From: luc...@mikemccandless.com >> Date: Thu, 19 Jul 2012 13:02:42 -0400 >> Subject: Re: Flushing Thread >> To: jav

RE: Flushing Thread

2012-07-19 Thread Simon McDuff
bject: Re: Flushing Thread > To: java-user@lucene.apache.org > > This has already been fixed on Lucene 4.0 (we now have fully > concurrent flushing), eg see: > > > http://blog.mikemccandless.com/2011/05/265-indexing-speedup-with-lucenes.html > > Mike McCandless > &

Re: Flushing Thread

2012-07-19 Thread Michael McCandless
This has already been fixed on Lucene 4.0 (we now have fully concurrent flushing), eg see: http://blog.mikemccandless.com/2011/05/265-indexing-speedup-with-lucenes.html Mike McCandless http://blog.mikemccandless.com On Thu, Jul 19, 2012 at 12:54 PM, Simon McDuff wrote: > > I see some behavio

Flushing Thread

2012-07-19 Thread Simon McDuff
I see some behavior at the moment when I'm flushing and would like to know if I can change that. One main thread is inserting, when it flushes, it blocks. During that time my main thread is blocking. Instead of blocking, Could it spawn another thread to do that ? Basically, would like to h