Re: Micro-batching in Kafka streams - redux

2017-10-20 Thread Matthias J. Sax
Hi, as Kafka Streams focuses on stream processing, micro-batching is something we don't consider. Thus, nothing has changed/improved. About the store question: If you buffer up your writes in a store, you need to delete those value from the store later on to avoid that the store grown unbounded.

Micro-batching in Kafka streams - redux

2017-10-20 Thread Shrijeet Paliwal
Kafka version: 0.10.2.1 (can upgrade if needed) I wish to revive the discussion around micro batching in Kafka streams. Some past discussions are here & here . I am exploring ways to do at-least-once proces