Re: Broker regularly facing memory issues

2019-09-29 Thread Arpit Gogia
Thanks for the input. I do plan on reducing the heap for the next restart. Initially I'd thought that less heap memory could also be the reason but since then I've learned that cannot be the issue. I also found the number 262144 online but I believe those results were related to Elastic Search. O

Re: Broker regularly facing memory issues

2019-09-27 Thread Karolis Pocius
How did you arrive at the 10 GB JVM heap value? I'm running Kafka on 16 GB RAM instances with ~4000 partitions each and only assigning 5 GB to JVM of which Kafka only seems to be using ~2 GB at any given time. Also, I've set vm.max_map_count to 262144 -- didn't use any formula to estimate that, mu