Re: Crashes caused by high deleted .dvd file mmap counts

2025-05-12 Thread Justin Borromeo
Hi Uwe, Setting -Dorg.apache.lucene.store.MMapDirectory.sharedArenaMaxPermits=64 didn't seem to help and we're still seeing restarts. A question about your response: what are normal update ratios? Each of our machines is running 32 OpenSearch shards (Lucene indexes), each with about 52 segments.

RAM-per-thread hard limit

2025-05-12 Thread Viliam ġurina
Hi all, we're building vector indexes and we'd like to achieve large segments. There's `IndexWriterConfig.setRAMPerThreadHardLimitMB` that defaults to 1945 and can be set to up to 2048 MB. I've commented out the precondition in the method and set the limit to 16384 and I have successfully built 6G