[ https://issues.apache.org/jira/browse/KAFKA-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023641#comment-16023641 ]
Jiangjie Qin commented on KAFKA-5211: ------------------------------------- [~enothereska] I think a KIP is only required if there is a public API change or user sensible behavior change. Some clarification regarding this ticket, in 0.10.2.1 the consumer does not skip over a corrupted message. A refactor at some point after that changed the behavior to skip over the corrupted messages without a KIP. We are changing the behavior back to be the same as 0.10.2.1 to avoid user sensible behavior change. So I don't think a KIP is required for this ticket. > KafkaConsumer should not skip a corrupted record after throwing an exception. > ----------------------------------------------------------------------------- > > Key: KAFKA-5211 > URL: https://issues.apache.org/jira/browse/KAFKA-5211 > Project: Kafka > Issue Type: Bug > Reporter: Jiangjie Qin > Assignee: Jiangjie Qin > Labels: clients, consumer > Fix For: 0.11.0.0 > > > In 0.10.2, when there is a corrupted record, KafkaConsumer.poll() will throw > an exception and block on that corrupted record. In the latest trunk this > behavior has changed to skip the corrupted record (which is the old consumer > behavior). With KIP-98, skipping corrupted messages would be a little > dangerous as the message could be a control message for a transaction. We > should fix the issue to let the KafkaConsumer block on the corrupted messages. -- This message was sent by Atlassian JIRA (v6.3.15#6346)