Re: monitoring topic subscriptions etc

2020-06-23 Thread Joris Peeters
Hi Ricardo, IIUC, your response assumes I'm talking about user events (such as ad clicks or so) that get published on a topic by some external process. That wasn't what I meant, though. What I want to track is actual Kafka broker events, such as a consumer group subscribing to a topic. Basically,

Re: monitoring topic subscriptions etc

2020-06-23 Thread Ricardo Ferreira
Joris, I think the best strategy here depends on how fast you want to get access to the user events. If latency is a thing then just read de data from the topic along with the other applications. Kafka follows the /write-once-read-many-times/ pattern which encourage developers to reuse the da