Re: Regarding the size of Flink cluster

2021-12-10 Thread Timo Walther
Hi Jessy, let me try to answer some of your questions. > 16 Task Managers with 1 task slot and 1 CPU each Every additional task manager also involves management overhead. So I would suggest option 1. But in the end you need to perform some benchmarks yourself. I could also imagine that a mixt

Regarding the size of Flink cluster

2021-12-10 Thread Jessy Ping
Hi All, I have the following questions regarding the sizing of the Flink cluster doing stateful computation using Datastream API. It will be better if the community can answer the below questions or doubts. Suppose we have a pipeline as follows, *Kafka real time events source1 & Kafka rules