Re: hnsw parameters for vector search

2024-02-01 Thread Michael Sokolov
To get best results it's necessary to tune these parameters for each vector model. My suggestion is to use a subset of your 100M vectors for parameter optimization to save time while iterating through the parameters space as you will indeed need to reindex in order to measure Generally speaking, i

Re: hnsw parameters for vector search

2024-01-30 Thread Michael Wechner
Re your "second" question about suboptimal results, I think Nils Reimers explains quite nicely why this might happen, see for example https://www.youtube.com/watch?v=Abh3YCahyqU HTH Michael Am 30.01.24 um 15:48 schrieb Moll, Dr. Andreas: Hi, the hnsw documentation for the Lucene HnswGraph

hnsw parameters for vector search

2024-01-30 Thread Moll, Dr. Andreas
Hi, the hnsw documentation for the Lucene HnswGraph and the SolR vector search is not very verbose, especially in regards to the parameters hnswMaxConn and hnswBeamWidth. I find it hard to come up with sensible values for these parameters by reading the paper from 2018. Does anyone have experie