[
https://issues.apache.org/jira/browse/KAFKA-19430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18014165#comment-18014165
]
Matthias J. Sax commented on KAFKA-19430:
-----------------------------------------
I see. The distinction between read and write path is very interesting. Thanks
for pointing it out. – This ticket is really about the consumer path only (so
far – not sure if we would want to extend it to the produce path, or if this
even necessary? – If it's a transient error on send() and retriable, I would
expect the producer to retry internally, not even raising the error to the
application/KS?)
{quote}On this last options is where it's not clear to me we would have the
info to know what to skip (where to seek to)
{quote}
Agreed. That's why the idea was, to just remember the position before calling
`poll()`, and if we get CorruptedRecordBack, we feed it into the handler, if
the handler returns CONTINUE, we advance position by one, and retry, and repeat
this until we get over the corrupted section?
> Don't fail on RecordCorruptedException
> --------------------------------------
>
> Key: KAFKA-19430
> URL: https://issues.apache.org/jira/browse/KAFKA-19430
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Reporter: Matthias J. Sax
> Assignee: Uladzislau Blok
> Priority: Major
>
> From [https://github.com/confluentinc/kafka-streams-examples/issues/524]
> Currently, the existing `DeserializationExceptionHandler` is applied when
> de-serializing the record key/value byte[] inside Kafka Streams. This implies
> that a `RecordCorruptedException` is not handled.
> We should explore to not let Kafka Streams crash, but maybe retry this error
> automatically (as `RecordCorruptedException extends RetriableException`), and
> find a way to pump the error into the existing exception handler.
> If the error is transient, user can still use `REPLACE_THREAD` in the
> uncaught exception handler, but this is a rather heavy weight approach.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
