I also recommend Prometheus. Works great with JMX for Kafka or any Java service.
Datadog is also fine if you want simple and don't spending money. Easy to integrate with alerting systems and great visualization. They have a good blogpost about integrating with Kafka and ZooKeeper: https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/ On 26 April 2018 at 08:02, Stanislav Antic <stanislav.an...@gmail.com> wrote: > I recommend setting up Prometheus which have Zookeeper exporter (helper > program which gives metrics from outside software) and you can use JMX > exporter with Kafka. > > You can find example configs in their repo, which is pretty good and you > also have already done Grafana dashboards (https://grafana.com/dashboards > ): > https://github.com/prometheus/jmx_exporter/tree/master/example_configs > > > On Thu, Apr 26, 2018 at 12:05 AM, Arunkumar <pm_arunku...@yahoo.com. > invalid> > wrote: > > > HI All > > I am working on setting up Monitoring and alerting for our production > > cluster. As of now we have a cluster of 3 zookeeper and 3 kafka Brokers > > which will expand later. > > We are planning for basic metrics (important ones) on which we need to > > alert. We are in a process of developing alerting system for our > cluster. I > > googled and did not get much detail as needed. > > I see many say the following ones are important and I understand these > are > > aggregate metrics across cluster (I may not be right).kafka.server:type= > > ReplicaManager,name=UnderReplicatedPartitionskafka.controller:type= > > KafkaController,name=OfflinePartitionsCountkafka.controller:type= > > KafkaController,name=ActiveControllerCount > > But I am looking for broker,topic etc metrics to alert. Can any one > > provide info or point to any docs on this regards will be of great > > help. Thanks in advance > > > > ThanksArunkumar Pichaimuthu, PMP > > > > > -- > Stanislav Antic > -- *Jonathan Bethune - **Senior Consultant* JP: +81 70 4069 4357 <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr> Read our latest technical blog posts here <https://www.instaclustr.com/blog/>. This email has been sent on behalf of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA). This email and any attachments may contain confidential and legally privileged information. If you are not the intended recipient, do not copy or disclose its content, but please reply to this email immediately and highlight the error to the sender and then immediately delete the message.
