Re: Offset commit request failing

2017-03-17 Thread Robert Quinlivan
Thanks for the response. Reading through that thread, it appears that this issue was addressed with KAFKA-3810 . This change eases the restriction on fetch size between replicas. However, should the outcome be a more comprehensive change to the seri

Re: Offset commit request failing

2017-03-17 Thread James Cheng
I think it's due to the high number of partitions and the high number of consumers in the group. The group coordination info to keep track of the assignments actually happens via a message that travels through the __consumer_offsets topic. So with so many partitions and consumers, the message g

Re: Offset commit request failing

2017-03-15 Thread Robert Quinlivan
I should also mention that this error was seen on broker version 0.10.1.1. I found that this condition sounds somewhat similar to KAFKA-4362 , but that issue was submitted in 0.10.1.1 so they appear to be different issues. On Wed, Mar 15, 2017 at 1

Offset commit request failing

2017-03-15 Thread Robert Quinlivan
Good morning, I'm hoping for some help understanding the expected behavior for an offset commit request and why this request might fail on the broker. *Context:* For context, my configuration looks like this: - Three brokers - Consumer offsets topic replication factor set to 3 - Auto c