Re: aggregating messages from topic during window period

2020-07-12 Thread Matthias J. Sax
You can use Kafka Streams: https://kafka.apache.org/25/documentation/streams/ The use case you describe sounds like a perfect fit it. You would need to use the `suppress()` operator: https://kafka.apache.org/25/documentation/streams/developer-guide/dsl-api.html#window-final-results >> My only con

aggregating messages from topic during window period

2020-07-12 Thread Alexey Vasiliev
Hi,   I’m trying to use kafka for the following use case: * My app receive events from external source; * It aggregates it during some window (say, 10 minutes); * Every 10 minutes it writes this aggregated data to external service. I was thinking about using kafka for this, so I’ll write incomi