Kafka error:- The requested operation can not be performed on a file with user-mapped section open.

2020-07-12 Thread Gagan Sabharwal
Hi team, I started 3 kafka servers on same machine listening to ports 9092,9093 and 9094 having their dedicated LOG and Data directories. I have created a topic with 1 partition and a replication factor of 3. Here is the code. NewTopic topic = new NewTopic("Queue", 1, (short) 3); Then I wrote

Re: aggregating messages from topic during window period

2020-07-12 Thread Matthias J. Sax
You can use Kafka Streams: https://kafka.apache.org/25/documentation/streams/ The use case you describe sounds like a perfect fit it. You would need to use the `suppress()` operator: https://kafka.apache.org/25/documentation/streams/developer-guide/dsl-api.html#window-final-results >> My only con

aggregating messages from topic during window period

2020-07-12 Thread Alexey Vasiliev
Hi,   I’m trying to use kafka for the following use case: * My app receive events from external source; * It aggregates it during some window (say, 10 minutes); * Every 10 minutes it writes this aggregated data to external service. I was thinking about using kafka for this, so I’ll write incomi