Re: [External] Monitoring Consumer

2021-05-25 Thread Tauzell, Dave
If you know the offset and partition of the message then you could use the api to determine when a consumer has acknowledged the message. From: Jason Turim Date: Tuesday, May 25, 2021 at 7:31 AM To: users@kafka.apache.org Subject: Re: [External] Monitoring Consumer One approach is to have the

Re: [External] Monitoring Consumer

2021-05-25 Thread Jason Turim
One approach is to have the consumer publish notifications about messages it has processed to a new topic (or other storage mechanism). You may be able to use the admin api, but I don't think it's a standard use case. On Tue, May 25, 2021, 8:21 AM Tauzell, Dave wrote: > I don’t know about monit

Re: [External] Monitoring Consumer

2021-05-25 Thread Tauzell, Dave
I don’t know about monitoring when a particular message is reads but you can use something like https://github.com/linkedin/Burrow to monitor consumer lag. Basically you can see that consumer Y has not yet read X number of messages that are ready. -Dave From: Alberto Moio Date: Tuesday, May