High CPU usage for idle kafka server

2015-06-04 Thread Anuja Pundlik (apundlik)
Hi, I am using Kafka 0.8.2.1. We have 1 zookeeper, 3 kafka brokers. We have 9 topics, out of which 1 topic has 18 partitions, while another has 12 partitions. All other topics have 1 partition each. We see that idle kafka brokers (not carrying any message) are using more than 50% of CPU. See to

Sys CPU and load average spikes with kafka cluster on Virtual Box

2015-08-19 Thread Anuja Pundlik (apundlik)
Hi All, We are running into a situation where System CPU (as seen in top) is increasing to 67%. Also the load average of system (as seen in top) increases to 25 Following is the setup. 1. One Zookeeper, 3 kafka brokers 2. This cluster is running on Centos 6.5 OS * Centos OS is the