RE: MmapDirectory and IndexReader reuse

2016-07-22 Thread Uwe Schindler
essage- > From: Vladimir Kotal [mailto:vladimir.ko...@oracle.com] > Sent: Thursday, July 21, 2016 7:34 PM > To: java-user@lucene.apache.org > Subject: Re: MmapDirectory and IndexReader reuse > > On 07/18/16 05:52 PM, Uwe Schindler wrote: > > Hi, > > > > Have a

Re: MmapDirectory and IndexReader reuse

2016-07-22 Thread Vladimir Kotal
On 07/21/16 20:18, Michael McCandless wrote: Can't you pass your own SearcherFactory to SearcherManager to do that? Aha ! That should be possible, thanks. v. - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org

Re: MmapDirectory and IndexReader reuse

2016-07-21 Thread Michael McCandless
Can't you pass your own SearcherFactory to SearcherManager to do that? Mike McCandless http://blog.mikemccandless.com On Thu, Jul 21, 2016 at 1:34 PM, Vladimir Kotal wrote: > On 07/18/16 05:52 PM, Uwe Schindler wrote: > >> Hi, >> >> Have a separate searcher manager for every directory. On ever

Re: MmapDirectory and IndexReader reuse

2016-07-21 Thread Vladimir Kotal
On 07/18/16 05:52 PM, Uwe Schindler wrote: Hi, Have a separate searcher manager for every directory. On every incoming search request, fetch the actual DirectoryReaders from the searcher managers and build a MultiReader from it. This costs nothing, as MultiReader is just a thin wrapper where

RE: MmapDirectory and IndexReader reuse

2016-07-18 Thread Uwe Schindler
://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Vladimir Kotal [mailto:vladimir.ko...@oracle.com] > Sent: Monday, July 18, 2016 5:00 PM > To: java-user@lucene.apache.org > Subject: Re: MmapDirectory and IndexReader reuse > > On 07/15/16 12:00 PM, Uwe Sc

Re: MmapDirectory and IndexReader reuse

2016-07-18 Thread Vladimir Kotal
On 07/15/16 12:00 PM, Uwe Schindler wrote: Hi, You should keep the IndexReader open for the whole time! Otherwise there are more bottlenecks and slowdowns. If you are updating the Index, you should use SearcherManager that reopens the index reader accordingly. After updating the index you sho

RE: MmapDirectory and IndexReader reuse

2016-07-15 Thread Uwe Schindler
r Kotal [mailto:vladimir.ko...@oracle.com] > Sent: Friday, July 15, 2016 11:49 AM > To: java-user@lucene.apache.org > Subject: MmapDirectory and IndexReader reuse > > > Hi all, > > when trying to identify bottlenecks in our application, I found that > each search which involve

MmapDirectory and IndexReader reuse

2016-07-15 Thread Vladimir Kotal
Hi all, when trying to identify bottlenecks in our application, I found that each search which involves multiple indexes is performing lots of mmap()/open() syscalls. This is a natural consequence of using MmapDirectory. So even if file system caches are properly warmed, this might add coupl