Hello, We're looking into using Kafka for a improved version of a system and the question of how to scale Kafka came up. Specifically, we want to try to make the system scale as transparently as possible. The concern was that if we go from N to N*2 consumers that we would have some that are still backed up while the new ones were working on only some of the new records. Also, if the load drops, can we scale down effectively?
I'm sure there's a way to do it. I'm just hoping that someone has some knowledge in this area. Thanks.
