You can use Prometheus for monitoring , AlertManager for alerting and Grafana
to view the real time graphs by using the metrics scraped by Prometheus.
For gathering the metrics of Kafka and Zookeeper , you can use jmx exporter.
Also, all metrics will not be useful for humans to read and underst
"Thirding" the use of prometheus, recommend reading this blog post as well:
https://www.robustperception.io/monitoring-kafka-with-prometheus
On Wed, Apr 25, 2018 at 11:39 PM, Jonathan Bethune <
jonathan.beth...@instaclustr.com> wrote:
> I also recommend Prometheus. Works great with JMX for Kafka
I also recommend Prometheus. Works great with JMX for Kafka or any Java
service.
Datadog is also fine if you want simple and don't spending money. Easy to
integrate with alerting systems and great visualization.
They have a good blogpost about integrating with Kafka and ZooKeeper:
https://www.dat
I recommend setting up Prometheus which have Zookeeper exporter (helper
program which gives metrics from outside software) and you can use JMX
exporter with Kafka.
You can find example configs in their repo, which is pretty good and you
also have already done Grafana dashboards (https://grafana.co
Check my curated list here. I’ll add this to an “awesome-Kafka” when I have
some time but you should be able to see 7-8 links I added recently specifically
on this subject.
http://leaves.anant.us/#!/?tag=kafka,monitoring
--
Rahul Singh
rahul.si...@anant.us
Anant Corporation
On Apr 25, 2018, 6
Hello Javier,
There are some ticket created for this purpose:
https://issues.apache.org/jira/browse/KAFKA-4212
https://issues.apache.org/jira/browse/KAFKA-4273
Please feel free to share your use cases on the ticket, so that we can
consider prioritizing this feature in Streams.
Guozhang
On W
HI All
I am working on setting up Monitoring and alerting for our production cluster.
As of now we have a cluster of 3 zookeeper and 3 kafka Brokers which will
expand later.
We are planning for basic metrics (important ones) on which we need to alert.
We are in a process of developing alerting s
I want to open a JIRA and a KIP. Can someone please grant me the necessary
permissions?
My username is *piyushvijay*.
Thank you
Piyush Vijay
Hi,
I have a look around the "state" folder in Kafka Streams and I realised that
only WindowStore and SessionStore allows configuring a retention policy.
Looking a bit further, it seems that RocksDbSegmentedBytesStore is the main way
to implement a store that can clean itself up based on retent
Hi Niels,
for using Kafka Connect, you must to define your connection configuration file
under kafka_2.11-1.0.0/config
(2.11-1.0.0 is just a example of kafka version). In config directory you can
create a connector file like "mysql-connect.properties"
and specify required parameters into this
Hi!
I am tying to use the confluent connector verson 4.0.1 to connect to
oracle and set up a jdbc source.
Apparently I need to set a jdbc connection property,
oracle.jdbc.timezoneAsRegion=false, when connecting to my oracle database.
But I cannot find out where to set it - it cannot be set
Thank you very much for your help!
Antoine
-Original Message-
From: Manikumar [mailto:manikumar.re...@gmail.com]
Sent: Wednesday, April 25, 2018 1:50 AM
To: Users
Subject: Re: Transfer data between kerberized kafka clusters (different
principals)
like this:
producerConfig.put("sasl.jaas
12 matches
Mail list logo
