Re: Dimensions Limit for KNN vectors - Next Steps

2023-05-12 Thread David Smiley
Both what Allesandro said and what Bruno said: make it configurable and move it. Both are good and not mutually exclusive and could happen in any order. Marcus, are you against configurability? In particular, I propose a simple Integer.getInteger("lucene.hnsw.maxDimensions", 1024). Your response

Re: Question for customize index segment search order

2023-05-12 Thread Mikhail Khludnev
Hello, Wei. Pardon for pinging you back to the Lucene field. Here's the loop over segments https://github.com/apache/lucene/blob/main/lucene/core/src/java/org/apache/lucene/search/IndexSearcher.java#L674 So, presumably: - custom searcher may loop segments out of order - custom wrapper over index