Re: Impact and WAND

2021-04-16 Thread Tomás Fernández Löbbe
Ah, great. Thanks! On Fri, Apr 16, 2021 at 10:57 AM Adrien Grand wrote: > Hi, > > Indeed BMW is only about disjunctions but the paper ( > http://engineering.nyu.edu/~suel/papers/bmw.pdf) shortly describes how > block max indexes can be used to speed up conjunctions as well using a > simple algor

Re: Impact and WAND

2021-04-16 Thread Adrien Grand
Hi, Indeed BMW is only about disjunctions but the paper ( http://engineering.nyu.edu/~suel/papers/bmw.pdf) shortly describes how block max indexes can be used to speed up conjunctions as well using a simple algorithm that they call Block Max And, which we implemented in the BlockMaxConjunctionScor

Re: Impact and WAND

2021-04-16 Thread Tomás Fernández Löbbe
I was looking at the nightly benchmarks[1] and noticed a big jump in performance for conjunction queries when LUCENE-8060 was merged. I was puzzled because I didn't expect BMW to help in this type of queries, but I guess that's the "other optimizations" you were talking about? Do you have any point

Re: Impact and WAND

2019-07-11 Thread Atri Sharma
Note that any other scoring mode (COMPLETE or COMPLETE_NO_SCORES) will mandatorily visit all hits, so there is no scope of skipping and hence no point of using impacts. On Thu, Jul 11, 2019 at 8:51 AM Wu,Yunfeng wrote: > > > @Adrien Grand mailto:jpou...@gmail.com>>. Thanks for your > reply. > >

Re: Impact and WAND

2019-07-10 Thread Adrien Grand
Block-max WAND and other optimizations that improve the retrieval of top hits (block-max WAND is about disjunctions, but we have optimizations for conjunctions, phrases and boolean queries that mix MUST and SHOULD clauses too) are only applied when the score mode is TOP_SCORES indeed. The level in

Re: Impact and WAND

2019-07-10 Thread Wu,Yunfeng
@Adrien Grand mailto:jpou...@gmail.com>>. Thanks for your reply. The explanation ` skip low-scoring matches` is great, I looked up some docs and inspect some related code. I noticed the ` block-max WAND` mode only work when ScoreMode.TOP_SCORES is used, is right? (The basic TermQuery wo

Re: Impact and WAND

2019-07-10 Thread Adrien Grand
To clarify, the scoring process is not accelerated because we terminate early but because we can skip low-scoring matches (there might be competitive hits at the very end of the index). CompetitiveImpactAccumulator is indeed related to WAND. It helps store the maximum score impacts per block of do