Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread Ishan Chattopadhyaya
Hi Rajani, Please feel free to submit guest posts to our SearchScale blog. We welcome posts on vector search. https://SearchScale.com/blog Thanks, Ishan On Fri, 29 Mar, 2024, 1:18 am rajani m, wrote: > @Alessandro, > Is there a solr blog site where we can submit work/articles or are you > sug

Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread rajani m
btw this article[1] by Tom Burgmans is relevant. It is posted on linkedin though and never came into my feed. I found it on the relevance-search slack channel. [1] https://www.linkedin.com/pulse/testing-dense-vector-search-scale-part-1-ann-tom-burgmans-0tale/ On Thu, Mar 28, 2024 at 3:47 PM raja

Re: highlighting performance

2024-03-28 Thread Maria Muslea
I just wanted to give an update on this. I rebuilt the index using storeOffsetsWithPositions=true for the relevant highlight fields, and I did see the size of the index increase, but I didn't see any significant improvement in query response time. Thank you, maria On Tue, Mar 19, 2024 at 9:46 AM

Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread rajani m
@Alessandro, Is there a solr blog site where we can submit work/articles or are you suggesting to post on my own site and share a link here? I prefer the former if there is one because there were times when I had my own, it hardly had any views and on top of that google blogging made me migrate fro

Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread rajani m
Run the same knn queries at a slow throughput for 30-60 minutes, this should warm up disk caches with hnsw index files, and then you should see a significant drop in the query time. Also make use of "fq" and reduce the document space as much as you can. On Thu, Mar 28, 2024 at 12:50 PM Iram Tariq

Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread Iram Tariq
Hi Alessandro, Thank you for the feedback. Kindly see my comments below, *Ale*: https://www.elastic.co/blog/accelerating-vector-search-simd-instructions, I suggest to experiment with simD vector improvements (unless you are already doing it) * We will try this soon. * *Ale*: What about the ma

Getting NPE while doing atomic updates using add-distinct for a multivalued field [Solr 8.11.2]

2024-03-28 Thread Akhilesh kumar .
Hello all, We’re using Solr for our e-commerce platform since many years. We do a lot of real-time updates and rely on the atomic updates mostly to update the documents. We ran into an issue with the atomic updates with add-distinct on the production environment, where we are getting NullPointe

Re: Performance Suggestion for Dense Vectors

2024-03-28 Thread Alessandro Benedetti
That's interesting. I think it's vital to get back some performance tests from the community. Since my contribution to support Vector-search in Apache Solr was merged, we got little or null feedback to understand its performance, in real-world use cases. Blogs, open benchmarks or even just this sor