Re: Kafka streams in Kubernetes

By default, Kafka Streams does not "close" windows. To handle out-of-order data, windows are maintained until their retention time passed, and are updated each time an out-of-order record arrives (even if window-end time passed). Cf https://stackoverflow.com/questions/38935904/how-to-send-final-k

Re: Kafka streams in Kubernetes

Pavel, Thanks for the pointer. I will take a look. -mohan On 6/8/19, 4:29 PM, "Pavel Sapozhnikov" wrote: I suggest take a look at Strimzi project https://strimzi.io/ Kafka operator deployed in Kubernetes environment. On Sat, Jun 8, 2019, 6:09 PM Parthasarathy, Mohan wr

Re: Kafka streams in Kubernetes

Matt, Thanks for your response. I agree with you that there is no easy way to answer this. I was trying to see what others experience is which could simply be "Don't bother, in practice stateful set is better". Could you explain as to why there has to be more state than the window size ? In a

Re: Parallel computation of windows in Flink

Sorry about that - this is definitely the wrong list. I meant to send that to the apache beam list. Ladder . The smart, modern way to insure your life. On Sat, Jun 8, 2019 at 12:44 PM Mike Kaplinskiy wrote: > Hi everyone, > > I’m using a Kafka source with a lot of waterm