[
https://issues.apache.org/jira/browse/KAFKA-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930742#comment-16930742
]
Alaa Zbair commented on KAFKA-7499:
-----------------------------------
Hi,
I have checked the KIP-399 and the discussion and also KIP-210.
So the question we need to answer is whether it's okay to also skip
writing the record in the internal topics, the current implementation of
'ProductionExceptionHandler' is applied for all topics and if we decided
to keep it that way, how to ensure that there will be no divergence in
local store and changelog topic ?
I would like to get input from others on what they think about this.
There is a point I don't understand which is: why in case of a
serialization error do we have the choice of either skipping it or
putting in the store ? shouldn't the record be correctly serialized
before putting it into the store ?
> Extend ProductionExceptionHandler to cover serialization exceptions
> -------------------------------------------------------------------
>
> Key: KAFKA-7499
> URL: https://issues.apache.org/jira/browse/KAFKA-7499
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Reporter: Matthias J. Sax
> Assignee: Alaa Zbair
> Priority: Major
> Labels: beginner, kip, newbie
>
> In
> [KIP-210|https://cwiki.apache.org/confluence/display/KAFKA/KIP-210+-+Provide+for+custom+error+handling++when+Kafka+Streams+fails+to+produce],
> an exception handler for the write path was introduced. This exception
> handler covers exception that are raised in the producer callback.
> However, serialization happens before the data is handed to the producer with
> Kafka Streams itself and the producer uses `byte[]/byte[]` key-value-pair
> types.
> Thus, we might want to extend the ProductionExceptionHandler to cover
> serialization exception, too, to skip over corrupted output messages. An
> example could be a "String" message that contains invalid JSON and should be
> serialized as JSON.
> KIP-399 (not voted yet; feel free to pick it up):
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-399%3A+Extend+ProductionExceptionHandler+to+cover+serialization+exceptions]
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
