Jakub Neubauer created KAFKA-3120:
-------------------------------------
Summary: Consumer doesn't get messages from some partitions after
reassign
Key: KAFKA-3120
URL: https://issues.apache.org/jira/browse/KAFKA-3120
Project: Kafka
Issue Type: Bug
Affects Versions: 0.9.0.0
Environment: Linux
Reporter: Jakub Neubauer
Priority: Critical
I tested some scenario on one-node cluster with this setup:
* A topic with 5 partitions, 1 replica.
* One producer (new java client)
* 2 consumers were started (let's say A and B). Using the new java client. 2
partitions to A, 3 partitions to B were assigned.
Then I stopped one of the consumers (cleanly). The partitions were re-assigned
(The consumer got all 5 partitions in the
"ConsumerRebalanceListener.onPartitionsAssigned" listener.
But as messages were produced, the living consumer received only messages of
some partitions (magically those that belonged to the now-dead consumer).
The messages were not lost. After I restarted the second consumer, it got the
messages that it previously didn't get. But without restarting, the messages
were not consumed by it.
It is quite serious issue, since there is no sign of something being wrong.
Everything seems to be working. So the administrator has no chance to get the
idea that (only some) messages are not consumed on the "healthy" system.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
