Hi, We have a Flink job reading from multiple Kafka topics based on a regex pattern.
What we have found out is that the topics are not shared between the kafka consumers in an even manner . Example if there are 8 topics and 4 kafka consumer operators . 1 consumer is assigned 6 topics , 2 consumers assigned 1 each and the last consumer is not assigned at all. This leads to inadequate usage of the resources. I could not find any setting/configuration which would make them as even as possible. Let me know if there's a way to do the same. Thanks, Prasanna.