Re: Kafka broker server high memory utilization

2019-06-25 Thread Parth Gandhi
Thanks Steve. So i shouldn't worry about increasing the RAM at this moment. Also do you think that the system resource are OK to handle the workload. 3 server - 2 core processor and 8 GB Ram. Retention policy is set to 168 hours. Thanks, Parth Gandhi DevOps On Tue, Jun 18, 2019 at 12:07 PM Ste

Re: Kafka broker server high memory utilization

2019-06-18 Thread Steve Howard
Hi Parth, Yes, this is by design. See the following URL, paying particularly close attention to the section on memory. https://docs.confluent.io/current/kafka/deployment.html Thanks, Steve On Tue, Jun 18, 2019 at 6:29 AM Parth Gandhi < parth.gan...@excellenceinfonet.com> wrote: > Hi, > > I a

Kafka broker server high memory utilization

2019-06-18 Thread Parth Gandhi
Hi, I am seeing my kafka broker server running at >90% memory and most of the memory is used by buffer/cache. Is this a normal expected behavior? or shall i look at increasing the Physical memory of the servers. [image: image.png] PS: I have 3 broker server with around 30+ topic and 400+ partition