Re: indexing performance 6.6 vs 7.1

2018-01-31 Thread Rob Audenaerde
Hi Adrian, Thanks for the response. Good points too! We actually went with a smallish benchmark to be able to profile the application within reasonable time. We will do a larger benchmark (say, 1M documents, without profiling) and I will revisit the commit-code as well. (IIRC we actually increas

Re: Increase search performance

2018-01-31 Thread Adrien Grand
Hi Atul, Le mar. 30 janv. 2018 à 16:24, Atul Bisaria a écrit : > 1. Using ConstantScoreQuery so that scoring overhead is removed since > scoring is not required in my search use case. I also use a custom Sort > object which does not sort by score (see code below). > If you don't sort by sc

Re: indexing performance 6.6 vs 7.1

2018-01-31 Thread Adrien Grand
Hi Rob, I don't think your benchmark is good. If I read it correctly, it only indexes between 21k and 22k documents, which is tiny. Plus it should try to better replicate production workload, otherwise we will draw wrong conclusions. I also suspect something is not quite right in your indexing co

Re: indexing performance 6.6 vs 7.1

2018-01-31 Thread Rob Audenaerde
Hi all, We ran the benchmarks (6.6 vs 7.1) with IW info stream and (as attachment cannot be too large) I uploaded them to google drive. They can be found here: https://drive.google.com/open?id=1-nAHgpPO3qZ78lnvvlQ0_lF4uHJ-cWLh Thanks in advance, -Rob On Mon, Jan 29, 2018 at 1:08 PM, Rob Audenae