Re: How to process KStream windowed message parallelly

2019-06-14 Thread Matthias J. Sax
There is no built-in support for this atm. Async processing support as suggested via KIP-408 might help in the future. But there in not much activity on this KIP atm. (https://cwiki.apache.org/confluence/display/KAFKA/KIP-408%3A+Add+Asynchronous+Processing+To+Kafka+Streams) > If I add submit Thre

How to process KStream windowed message parallelly

2019-06-13 Thread Divya Goel
Hi, I have the requirement to dedup messages within the window and take bunch of actions on the filtered message. I understand that we can get parallelism with the number of Kstream thread and can get maximum parallelism as number of partitions. But the actions that I take on the filtered messa