Monitoring Kafka

2018-04-21 Thread Raghu Arur
Hi, Is there a way to pull broker stats (like partitions its is managing, jvm info, state of the partitions, etc.) without using JMX. We are shipping kafka in a appliance and there are restrictions on the ports that are open for security reasons. Are there any known ways of monitoring the health o

Re: Monitoring Kafka

2018-04-21 Thread Raghu Arur
them but its a starting > > > point. > > > > > > https://blog.serverdensity.com/how-to-monitor-kafka/ > > > https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/ > > > > > > > > > On Apr 21, 2018, 6:54 AM -0400, Raghu Arur ,

Kafka rebalancing behavior on broker failures

2018-04-22 Thread Raghu Arur
I have a few questions on behavior of kafka w.r.t to broker life-cycle changes. 1. When a new broker is added to the cluster, do we need to manually invoke rebalancing or based on the load, kafka automatically invokes rebalancing ? 2. When an active broker goes down, does Kafka moves the partitio