Minimum replication for Exactly Once semantics

2019-12-11 Thread Rajesh Kalyanasundaram
Hi all, Kafka Streams application with Exactly once processing semantics, the default replication factor of broker is 3 i.e transaction.state.log.replication.factor In doc its mentioned that atleast 3 brokers are required for exactly once. What is the minimum replication factor required for exac

Re: Dynamic window size for aggregations

2019-04-09 Thread Rajesh Kalyanasundaram
to create a feature request JIRA. For now, you could use a custom processor (via `.transform()`) that uses an attached window store to implement the logic you need. -Matthias On 4/9/19 4:09 AM, Rajesh Kalyanasundaram wrote: > Hi all, > We have a requirement to im

Dynamic window size for aggregations

2019-04-09 Thread Rajesh Kalyanasundaram
Hi all, We have a requirement to implement aggregations with TimedWindows which may have varying window sizes. For example, I may want a tumbling window that tumbles on 31st of Jan and 28th of Feb, 31st of March and so on. We did initial analysis of TimedWindows. Found that the windoSize is being