Re: Kafka JMX monitoring

2020-03-19 Thread George
I would re-iterate Prometheus, it allows for node_collector that also gives you OS metrics, + the JMX integration that tells you how the Java servers are doing + the topic depth modules. All going into prometheus, all visualised nicely as one pane of glass via Grafana. and well if you doing codi

Re: Kafka JMX monitoring

2020-03-19 Thread Sachin Mittal
How about jmxterm. https://cwiki.apache.org/confluence/display/KAFKA/jmxterm+quickstart I have found this very helpful. On Thu, Mar 19, 2020 at 3:51 PM Gioacchino Vino wrote: > Hi, > > > I would like to share my experience with you. > > Even if I found out that prometheus is the a simple and fa

Re: Kafka JMX monitoring

2020-03-19 Thread Gioacchino Vino
Hi, I would like to share my experience with you. Even if I found out that prometheus is the a simple and fast solution, since I'm using InfluxDB (and Telegraf) in my project, I'm using the chain: Jolokia -> Telegraf -> InfluxDB -> Grafana Some useful links: https://jolokia.org/ https://

Re: Kafka JMX monitoring

2020-03-19 Thread sunil chaudhari
If you are not aware of Grafana and Prometheus then... You can enable JMx_PORT on kafka broker. Install and run kafka manager. https://github.com/lemastero/kafka-manager There you can see metrics on kafka manager UI. But yes, grafana-prometheus is Better one. On Thu, 19 Mar 2020 at 12:25 PM, 张祥

Re: Kafka JMX monitoring

2020-03-19 Thread George
How about using JMP -> Prometheus integration. Then you can visualise using Grafana and you can use the Prometheus alert / notification framework also. G On Thu, Mar 19, 2020 at 8:55 AM 张祥 wrote: > Hi, > > I want to know what the best practice to collect Kafka JMX metrics is. I > haven't found

Kafka JMX monitoring

2020-03-18 Thread 张祥
Hi, I want to know what the best practice to collect Kafka JMX metrics is. I haven't found a decent way to collect and parse JMX in Java (because it is too much) and I learn that there are tools like tools like jmxtrans to do this. I wonder if there is more. Thanks. Regards.