Re: Crashes caused by high deleted .dvd file mmap counts

2025-05-06 Thread Ankit Jain
Hi Justin, This question is better for the OS community, as some of the settings are specific to OpenSearch. Will really appreciate, if you can create an OpenSearch issue . We can always follow up with the Lucene community, if it turns out

Crashes caused by high deleted .dvd file mmap counts

2025-05-06 Thread Justin Borromeo
Hi all, After upgrading our OpenSearch cluster from 2.16.0 to 2.19.1 (moving from Lucene 9.10 to Lucene 9.12), our largest clusters started crashing with the following error: # There is insufficient memory for the Java Runtime Environment to continue. # Native memory allocation (malloc) failed t

Regarding Clustering Support in Lucene

2025-05-06 Thread Arun Kumar Kalakanti
Dear all, Lucene 10.1 introduced "experimental" KMeans clustering of vectors. However, I couldn't find it in the 10.2 version. Ref: https://lucene.apache.org/core/10_1_0/sandbox/org/apache/lucene/sandbox/codecs/quantization/KMeans.html Could you please share the plans, if any, or alternatives in