Re: Sharing buffer between large number of IndexWriters?

2020-06-22 Thread Andrzej Białecki
Hi Marcin, I’m working on a somewhat similar problem in Solr, also with the goal to better handle multi-tenant Solr clusters (SOLR-13579). It’s probably not directly applicable to your scenario but one costly lesson that I learned (obvious in hindsight ;) ) is that when things happen not instan

Re: Sharing buffer between large number of IndexWriters?

2020-06-22 Thread Michael McCandless
Hello Marcin, Alas, Lucene does not have this capability out of the box. However, you are able to live-update the IndexWriterConfig.setRAMBufferSizeMB, and the change should take effect on the next document indexed in that IndexWriter instance. So you could build your own "proportional RAM" on t