Jason Gustafson created KAFKA-12606:
---------------------------------------
Summary: Some improvements for produce record validation
Key: KAFKA-12606
URL: https://issues.apache.org/jira/browse/KAFKA-12606
Project: Kafka
Issue Type: Improvement
Reporter: Jason Gustafson
KIP-467 introduces an extension to the produce response to let the producer
identify the specific records that had failed validation. While implementing
KAFKA-12548, we realized a few shortcomings in this proposal:
1. Some records may fail only because they are part of a batch which had a
record failing validation. In this case, we can return a better exception to
the user so that they know the record is safe to be retried. For example,
`RecordNotAppendedException` or something like that.
2. Records in the same batch may fail validation for different reasons. For
example, one record may fail because of an invalid timestamp; another may fail
because it uses a null key and the topic is compacted. However, the schema only
allows a single error for each partition, so we cannot distinguish these cases
in order to throw more specific exception types.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
