Re: Dense Vector - Similarity Function

2024-01-02 Thread Charlie Hull
I'm really glad Alessandro has been explicit about the challenges around developing open source software such as Solr. Simply put, there is lots of work and not enough people able or willing to do it. At my previous company Flax we funded a lot of Lucene/Solr development over the years, and Op

Re: Dense Vector - Similarity Function

2024-01-02 Thread Alessandro Benedetti
Are you a Lucene or a Solr user? I assumed the latter. In Apache Solr It's not only not released yet, it's not implemented yet. There's no official roadmap in Apache Solr no there's no release date for that functionality. That feature is among the ones I and my company want to contribute but we l

Re: Dense Vector - Similarity Function

2024-01-02 Thread Iram Tariq
Hi, What Mikhail mentioned is the answer to all my questions but sadly it is not released yet. Is there any way I can use this unreleased version for now or when it is going to be released ? and yes I want to rescore all topK results based on recency. Regards, Iram Tariq | Software Architect

Re: Dense Vector - Similarity Function

2024-01-02 Thread Alessandro Benedetti
Hi Iram, following up on Mikhail's answer: 1) K Nearest Neighbour is a retrieval approach intended to look for the closest(approximate) K vectors to a query one. "override the existing function or write a custom method to give a high score to the latest documents" It seems suspicious to me. It's

Re: Dense Vector - Similarity Function

2023-12-25 Thread Mikhail Khludnev
Hello Iram. The latter one was recently added into Lucene "all vectors within a radius" https://github.com/apache/lucene/pull/12679 Regarding the former, I suppose it can be achieved with reranking. On Tue, Dec 26, 2023 at 1:56 AM Iram Tariq wrote: > Hi All, > > Right now I am using the cosine s

Dense Vector - Similarity Function

2023-12-25 Thread Iram Tariq
Hi All, Right now I am using the cosine similarity function for dense vectors. Is there any way I can override the existing function or write a custom method to give a high score to the latest documents. Also KNN Query Parser returns topK results matched with the input, but is there anyway possi