[ https://issues.apache.org/jira/browse/KAFKA-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849503#comment-15849503 ]
ASF GitHub Bot commented on KAFKA-3959: --------------------------------------- GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/2484 KAFKA-3959: Follow-up; move upgrade notes to 0.10.3 upgrade section. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ewencp/kafka kafka-3959-followup-upgrade-docs Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/2484.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2484 ---- commit 49b8972220249932570a33610655af89878da7cd Author: Ewen Cheslack-Postava <m...@ewencp.org> Date: 2017-02-02T06:29:48Z KAFKA-3959: Follow-up; move upgrade notes to 0.10.3 upgrade section. ---- > __consumer_offsets wrong number of replicas at startup > ------------------------------------------------------ > > Key: KAFKA-3959 > URL: https://issues.apache.org/jira/browse/KAFKA-3959 > Project: Kafka > Issue Type: Bug > Components: consumer, offset manager, replication > Affects Versions: 0.9.0.1, 0.10.0.0, 0.10.0.1, 0.10.0.2, 0.10.1.0, > 0.10.1.1, 0.10.1.2 > Environment: Brokers of 3 kafka nodes running Red Hat Enterprise > Linux Server release 7.2 (Maipo) > Reporter: Alban Hurtaud > Assignee: Onur Karaman > Priority: Blocker > Labels: needs-kip, reliability > Fix For: 0.10.3.0 > > > When creating a stack of 3 kafka brokers, the consumer is starting faster > than kafka nodes and when trying to read a topic, only one kafka node is > available. > So the __consumer_offsets is created with a replication factor set to 1 > (instead of configured 3) : > offsets.topic.replication.factor=3 > default.replication.factor=3 > min.insync.replicas=2 > Then, other kafka nodes go up and we have exceptions because the replicas # > for __consumer_offsets is 1 and min insync is 2. So exceptions are thrown. > What I missed is : Why the __consumer_offsets is created with replication to > 1 (when 1 broker is running) whereas in server.properties it is set to 3 ? > To reproduce : > - Prepare 3 kafka nodes with the 3 lines above added to servers.properties. > - Run one kafka, > - Run one consumer (the __consumer_offsets is created with replicas =1) > - Run 2 more kafka nodes -- This message was sent by Atlassian JIRA (v6.3.15#6346)