Re: How to stop partition rebalancing

2019-10-09 Thread Matthias J. Sax
The pattern you apply seems to be an anti-pattern. If you have only 2 partitions, only 2 consumer instances within a group can consumer data -- hence, you should either only use 2 pods, or you should increase the number of partitions. What you try to do atm, won't work smoothly no matter what you

Re: How to stop partition rebalancing

2019-10-09 Thread M. Manna
Hi, If you choose not to close consumer, but only poll as a background thread it, the rebalance wouldn’t take place. This is only if you are sending heartbeats (via Poll() ) within the timeout period. Also, if one of the pod dies, rebalance has to happen. You’d want a fare share of work. An examp