RE: JMX Metrics to display disk Usage

2020-01-09 Thread JOHN, BIBIN
I already have Prometheus/Grafana for monitoring for most of the metrics. But I was looking for metrics which shows disk usage per broker/topic. -Original Message- From: George Sent: Thursday, January 9, 2020 10:49 PM To: users@kafka.apache.org Subject: Re: JMX Metrics to display

Re: JMX Metrics to display disk Usage

2020-01-09 Thread George
Why not rather use Prometheus with node-app module deployed on all involved hosts, Producers, consumers, brokers etc, You can also use prometheus to integrate with Kafka via JMX to expose it's kafka metrics, Display all via a Grafana dashboard G On Fri, Jan 10, 2020 at 6:21 AM Peter Bukowinski

Re: JMX Metrics to display disk Usage

2020-01-09 Thread Peter Bukowinski
Kafka does not report collect/report on topic data filesystem usage. I used this collectd project to help me collect the topic usage data and export it to graphite: https://github.com/HubSpot/collectd-kafka-disk/blob/master/README.md The plugin collects the size of each topic-partition director

JMX Metrics to display disk Usage

2020-01-09 Thread JOHN, BIBIN
Is there any metrics available to view disk usage in each broker/topic via JMX exporter? If yes, could you please send me details? Thanks