Re: Monitoring streams

2019-07-23 Thread Guozhang Wang
Hello Brian, I think your main question is to distinguish 1) broker is alive but there's no new data coming into the source topics to process, and 2) broker is not alive and hence nothing is readable, in your monitoring system. I agree that currently process-rate / last-record-timestamp cannot suc

Monitoring streams

2019-07-08 Thread Brian Putt
Hello, We have multiple stream services that we're looking to monitor when they've been disconnected from the broker so that we can restart the services. I've looked at https://issues.apache.org/jira/browse/KAFKA-6520 and am wondering if anyone has suggestions on what we can do today to help ensu