Re: Re-ranking using cross-encoder after vector search (bi-encoder)

2023-02-11 Thread Michael Wechner
Thanks for your feedback! To better understand your answer I would like to consider the following code / example: My code currently kind of looks like int k = 3; String question = "How old is Michael?"; IndexSearcher searcher =new IndexSearcher(indexReader); float[] queryVector = getEmbedding(

Re: Re-ranking using cross-encoder after vector search (bi-encoder)

2023-02-10 Thread Robert Muir
I think it would be good to provide something like a VectorRerankField (sorry for the bad name, maybe FastVectorField would be amusing too), that just stores vectors as docvalues (no HNSW) and has a newRescorer() method that implements org.apache.lucene.search.Rescorer. Then its easy to do as that