Re: lucene index reader performance

2016-07-07 Thread Tarun Kumar
Any suggestions pls? On Mon, Jul 4, 2016 at 3:37 PM, Tarun Kumar wrote: > Hey Michael, > > docIds from multiple indices (from multiple machines) need to be > aggregated, sorted and first few thousand new to be queried. These few > thousand docs can be distributed among multiple

Re: lucene index reader performance

2016-07-04 Thread Tarun Kumar
llions of documents. > > Maybe you could make a custom collector, and use doc values, to do your > own custom aggregation. > > Mike McCandless > > http://blog.mikemccandless.com > > On Mon, Jul 4, 2016 at 1:39 AM, Tarun Kumar wrote: > >> Thanks for reply Michael! I

Re: lucene index reader performance

2016-07-03 Thread Tarun Kumar
be used to load just a few hits, like a > page worth or ~ 10 documents, per search. > > Mike McCandless > > http://blog.mikemccandless.com > > On Tue, Jun 28, 2016 at 7:05 AM, Tarun Kumar wrote: > >> I am running lucene 4.6.1. I am trying to get documents correspond

lucene index reader performance

2016-06-28 Thread Tarun Kumar
I am running lucene 4.6.1. I am trying to get documents corresponding to docIds. All threads get stuck (don't get stuck exactly but spend a LOT of time in) at: java.lang.Thread.State: RUNNABLE at sun.nio.ch.FileDispatcherImpl.pread0(Native Method) at sun.nio.ch.FileDispatcherImpl.p