I have a cluster with 18 task managers 4 task slots each running a job whose source/sink(s) are declared with FlinkSQL using the Kafka connector. The topic being read has 36 partitions. The problem I'm observing is that the subtasks for the sources are not evenly distributed. For example, 1 task manager will have 4 active source subtasks and other TM's none. Is there a way to force each task manager to have 2 active source subtasks. I tried using the setting cluster.evenly-spread-out-slots: true , but that didn't have the desired effect.
-- Thank you, Aeden