[ 
https://issues.apache.org/jira/browse/KAFKA-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023641#comment-16023641
 ] 

Jiangjie Qin commented on KAFKA-5211:
-------------------------------------

[~enothereska] I think a KIP is only required if there is a public API change 
or user sensible behavior change. 

Some clarification regarding this ticket, in 0.10.2.1 the consumer does not 
skip over a corrupted message. A refactor at some point after that changed the 
behavior to skip over the corrupted messages without a KIP. We are changing the 
behavior back to be the same as 0.10.2.1 to avoid user sensible behavior 
change. So I don't think a KIP is required for this ticket.

> KafkaConsumer should not skip a corrupted record after throwing an exception.
> -----------------------------------------------------------------------------
>
>                 Key: KAFKA-5211
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5211
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Jiangjie Qin
>            Assignee: Jiangjie Qin
>              Labels: clients, consumer
>             Fix For: 0.11.0.0
>
>
> In 0.10.2, when there is a corrupted record, KafkaConsumer.poll() will throw 
> an exception and block on that corrupted record. In the latest trunk this 
> behavior has changed to skip the corrupted record (which is the old consumer 
> behavior). With KIP-98, skipping corrupted messages would be a little 
> dangerous as the message could be a control message for a transaction. We 
> should fix the issue to let the KafkaConsumer block on the corrupted messages.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to