Re: SortingMergePolicy in Lucene 6

2016-06-10 Thread Sheng
Thanks a lot for the explanation. That's all I want to know :) Cheers, On Wednesday, June 8, 2016, Michael McCandless wrote: > Sorry for the slow response: this one almost fell past the event horizon > of my todo list ;) > > Do you mean you are using document blocks (IW.addDocuments) and block

Re: SortingMergePolicy in Lucene 6

2016-06-08 Thread Michael McCandless
Sorry for the slow response: this one almost fell past the event horizon of my todo list ;) Do you mean you are using document blocks (IW.addDocuments) and block grouping (BlockGroupingCollector)? Any merge policy is fine with that (merging cannot break up document blocks), but with index time so

Re: SortingMergePolicy in Lucene 6

2016-05-25 Thread Sheng
Michael - That is a great article to read - thank you for the detailed explanation of the situation! We are not in production yet, so I am ok to wait a bit until 6 is in a more mature shape. For now, I am going to use a LogMergePolicy instead. That does bring up another question. As we are using Lu

Re: SortingMergePolicy in Lucene 6

2016-05-25 Thread Michael McCandless
Sorry, yes, dimensional points and SlowCompositeReaderWrapper are not compatible. This class (SlowCompositeReaderWrapper) is a terrible class that we have been gradually (past 7 years) phasing out of Lucene. It's a leaky abstraction (http://www.joelonsoftware.com/articles/LeakyAbstractions.html)