Hi, I use https://github.com/prometheus/jmx_exporter for collecting broker metrics and integrating them into prometheus.
Hope this helps. Greetings, Claudia -----Ursprüngliche Nachricht----- Von: Pushkar Deole <pdeole2...@gmail.com> Gesendet: Mittwoch, 15. Juli 2020 09:07 An: users@kafka.apache.org Betreff: Re: kafka per topic metrics We are using prometheus as metrics collection and storage system and Grafana for displaying those metrics, so integration with them is required On Wed, Jul 15, 2020 at 11:11 AM rohit garg <rohit.gar...@gmail.com> wrote: > You can try using kafka manager and check it will fullfill most of > requirement of yours. > > Thanks and Regards, > Rohit > > On Wed, Jul 15, 2020, 10:33 Pushkar Deole <pdeole2...@gmail.com> wrote: > > > Hi All, > > > > Any inputs as to how the kafka consumer and producer metrics can be > hooked > > up to a monitoring system such as prometheus ? > > > > On Tue, Jul 14, 2020 at 4:22 PM Pushkar Deole <pdeole2...@gmail.com> > > wrote: > > > > > i did find these metrics from confluent docs: however how can i > > > get > this > > > metric ? is it available at kafka broker? > > > > > > Per-Topic Metrics > > > > > > MBean: > > > > > > kafka.producer:type=producer-topic-metrics,client-id=([-.w]+),topic=([ > -.w]+) > > > record-send-rateThe average number of records sent per second for > > > a > > topic. > > > > > > On Tue, Jul 14, 2020 at 3:27 PM Pushkar Deole > > > <pdeole2...@gmail.com> > > > wrote: > > > > > >> Hi All, > > >> > > >> Need some help on kafka metrics, i am interested in certain > > >> metrics > e.g. > > >> i need to know the number of records published on a particular > > >> topic > and > > >> number of records consumed from that topic by a specific consumer > > group, i > > >> would need a total of these 2 and also average per second for them. > > >> > > >> Are those metrics available on kafka brokers and if yes then > > >> which are those metrics that would give me above counts? > > >> > > > > > >
