RE: Is it possible to normalise BM25 scores in the query level?

2017-06-29 Thread Rifat
not find a way to get number of query tokens inside a script. So do I have to write my custom Lucene/elasticsearch query for this? Is there any other possible way? thanks rifat -- View this message in context: http://lucene.472066.n3.nabble.com/Is-it-possible-to-normalise-BM25-scores-in-the

RE: Is it possible to normalise BM25 scores in the query level?

2017-06-27 Thread Rifat
Thanks for your message. In our use case, we want to perform learning to rank and train a decision tree using BM25 scores as one of our features. Decision trees requires normalised features to be able to properly split the data. Since BM25 scores for different queries varies considerably, decision

Is it possible to normalise BM25 scores in the query level?

2017-06-27 Thread Rifat
score for that query? Since lucene processes docs one at a time and return score for that document, at that moment, it seems not easy to do the normalisation. thanks, rifat -- View this message in context: http://lucene.472066.n3.nabble.com/Is-it-possible-to-normalise-BM25-scores-in-the-query