Hello! I'm working with a topic of largely variable partition sizes. My biggest concern is that I have no control over which keys are assigned to which consumers in my consumer group, as the amount of data my consumer sees is directly reflected on it's work load. Is there a way to distribute partitions to consumers evenly based on the size of each partition? The provided Consumer Rebalancing Algorithm prioritizes assigning consumers even numbers of partitions, regardless of their size.
Regards, Joel