Re: Best Practice Scaling Consumers

Hi Morritz - I don’t believe the number of Kafka consumers is restricted to the number of partitions. When you create a topic - and indicate both the number of partitions and a key - it causes your key value pairs to be allocated to a specific partition on the basis of a hash function on the

Re: Best Practice Scaling Consumers

1. Yes, you may have to overprovision the number of partitions to handle the load peaks. Refer this document to choose the no. of partitions. 2. KIP-429