Re: Other vector similarity metric than provided by VectorSimilarityFunction

2023-01-14 Thread Michael Wechner
Hi Adrien Thanks for your feedback! Whereas I am not sure I fully understand what you mean At the moment I am using something like: float[] vector = ...; FieldType vectorFieldType = KnnVectorField.createFieldType(vector.length, VectorSimilarityFunction.COSINE); KnnVectorField vectorField =ne

Re: Other vector similarity metric than provided by VectorSimilarityFunction

2023-01-14 Thread Adrien Grand
Hi Michael, You could create a custom KNN vectors format that ignores the vector similarity configured on the field and uses its own. Le sam. 14 janv. 2023, 21:33, Michael Wechner a écrit : > Hi > > IIUC Lucene currently supports > > VectorSimilarityFunction.COSINE > VectorSimilarityFunction.DO

Other vector similarity metric than provided by VectorSimilarityFunction

2023-01-14 Thread Michael Wechner
Hi IIUC Lucene currently supports VectorSimilarityFunction.COSINE VectorSimilarityFunction.DOT_PRODUCT VectorSimilarityFunction.EUCLIDEAN whereas some embedding models have been trained with other metrics. Also see https://docs.scipy.org/doc/scipy/reference/generated/scipy.spatial.distance.cdi