Braedon Vickers created KAFKA-4600:
--------------------------------------
Summary: Consumer proceeds on when ConsumerRebalanceListener fails
Key: KAFKA-4600
URL: https://issues.apache.org/jira/browse/KAFKA-4600
Project: Kafka
Issue Type: Bug
Components: consumer
Affects Versions: 0.10.1.1
Reporter: Braedon Vickers
One of the use cases for a ConsumerRebalanceListener is to load state necessary
for processing a partition when it is assigned. However, when
ConsumerRebalanceListener.onPartitionsAssigned() fails for some reason (i.e.
the state isn't loaded), the error is logged and the consumer proceeds on as if
nothing happened, happily consuming messages from the new partition. When the
state is relied upon for correct processing, this can be very bad, e.g. data
loss can occur.
It would be better if the error was propagated up so it could be dealt with
normally. At the very least the assignment should fail so the consumer doesn't
see any messages from the new partitions, and the rebalance can be reattempted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
