Re: Getting consumer offset lag in Kibana or grafana

2016-09-28 Thread Gwen Shapira
As mentioned in our docs (http://kafka.apache.org/082/documentation.html#monitoring) the 0.8.2 high level consumer has MBean called kafka.consumer:type=ConsumerFetcherManager,name=MaxLag,clientId=([-.\w]+) You should be able to use that. On Wed, Sep 28, 2016 at 7:10 AM, Vikas Bhatia -X (vikbhati

Getting consumer offset lag in Kibana or grafana

2016-09-28 Thread Vikas Bhatia -X (vikbhati - ARICENT TECHNOLOGIES MAURIITIUS LIMITED at Cisco)
Hi, I am running kafka version 0.8.2. I have scenarios where there is single producer client and multiple consumer clients. All consumers consume from the same topic. We differentiate consumers using the "consumerGroupId". Now I have a requirement where I need offset value for each consumer. I