A Design Question that needs verification: 1. Created a topic T with 'n' partitions. 2. Created a consumer group process with 'n + 1' threads subscribing from topic 'T' with a groupID 'y' 3. Added another consumer group process with 'n + 1' threads subscribing from same topic 'T' with same groupID 'y'
On doing so, I noticed that the previous consumer group stops consuming and the new consumer beings to consume I was attempting to model on demand parallelization in an event where an consumer group cannot keep up with the events produced. Rather than increase the threadpool capacity in the same process, it would make sense to distribute the load across multiple processes. Advice please? Regards Amardeep