RE: How to regulate native memory?

Hi, As a suggestion from my side: As a first thing: disable the bootstrap.memory_lock feature: https://www.elastic.co/guide/en/elasticsearch/reference/5.5/important-settings.html#bootstrap.memory_lock It looks like you are using too much heap space and some plugin in your ES installation also

Re: How to regulate native memory?

>From the lucene side, it only uses file mappings for reads and doesn't allocate any anonymous memory. The way lucene uses cache for reads won't impact your OOM (http://www.linuxatemyram.com/play.html) At the end of the day you are running out of memory on the system either way, and your process m

Re: How to regulate native memory?

Yeah, apologies for that long issue - the netty comments aren't related. My two comments near the end might be more interesting here: https://github.com/elastic/elasticsearch/issues/26269#issuecomment-326060213 To try to summarize, I looked to `/proc/$pid/smaps | grep indices` to quantify

Re: How to regulate native memory?

Hello, >From the thread linked there, its not clear to me the problem relates to lucene (vs being e.g. a bug in netty, or too many threads, or potentially many other problems). Can you first try to determine to breakdown your problematic "RSS" from the operating system? Maybe this helps determine

How to regulate native memory?

Our elasticsearch processes have been slowly consuming memory until a kernel OOM kills it. Details are here: https://github.com/elastic/elasticsearch/issues/26269 To summarize: - Explicit GC is enabled - MaxDirectMemorySize is set -

Better CamelCase support

Hi, some time ago I've submitted a patch here https://github.com/apache/lucene-solr/pull/231 and created a JIRA issue here https://issues.apache.org/jira/browse/LUCENE-7929 for a simple modification to WordDelimiterGraphFilter. This modification provides better support for camel case words. Wi

Document updating and SortedSetDocValuesFacetField

?Hi everyone, Short question is: How do one update document that already has some SortedSetDocValuesFacetFields? Longer story is here... I'm using SortedSetDocValuesFacetField and faceting feature to implement "count by group" and everything works fine when I store the document for first time, s