Re: Monitoring Producers at Large Scale

2014-06-25 Thread Neha Narkhede
We monitor producers or for that matter any process/service using JMX metrics. Every server and service in LinkedIn sends metrics in a Kafka message to a metrics Kafka cluster. We have subscribers that connect to the metrics cluster to index that data in RRDs. Our aim is to expose all important me

Re: Monitoring Producers at Large Scale

2014-06-24 Thread Darion Yaphet
Sorry I want to know you want to monitor kafka producers or kafka brokers and zookeepers ? It's seems you will want to monitor monitor Exceptions eg Leader Not Found, Queue is full, resend fail etc are kafka cluster 2014-06-25 8:20 GMT+08:00 Bhavesh Mistry : > We use Kafka as Transport Layer