Re: Perf comparision for MMapDirectory Vs NIOFSDirectory

2025-05-23 Thread ashwini singh
Thanks! On Wed, 21 May 2025 at 23:35, Adrien Grand wrote: > Hello Ashwini, > > MMapDirectory will often perform a bit faster. While NIOFSDirectory needs > to first copy data from the buffer cache to heap arrays, MMapDirectory can > read directly into the buffer cache. > > Lucene's benchmark suit

Re: RAM-per-thread hard limit

2025-05-23 Thread Uwe Schindler
Hi, The segment size and this buffer parameter are unrelated to each other. Lucene builds smaller segments during index, but they are merged at a later stage anyways, so producing larger segments from the beginning and hitting limits like you see is not required for fast search. So raising th

Re: RAM-per-thread hard limit

2025-05-23 Thread Viliam ġurina
My index was only vectors, plus a small string ID. That is probably the reason why it didn't hit any issue. When I added a larger text field to the document, I've hit this exception: Exception in thread "Thread-0" java.lang.RuntimeException: java.lang.ArithmeticException: integer overflow at com.d