Nigel Liang created KAFKA-9314:
----------------------------------
Summary: Connect put() and poll() retries not conforming to KIP-298
Key: KAFKA-9314
URL: https://issues.apache.org/jira/browse/KAFKA-9314
Project: Kafka
Issue Type: Bug
Components: KafkaConnect
Reporter: Nigel Liang
Assignee: Nigel Liang
KIP-298 outlines the retry policy of Connect when errors are encountered. In
particular, it proposes to retry on {{RetriableException}} on put() in SinkTask
and poll() in SourceTask.
However, the code does not reflect this change. For instance, WorkerSourceTask
handles {{RetriableException}} thrown from {{poll()}} by entering into a tight
retry loop without backoff. This has led to connectors having to workaround by
simply not retrying and failing the task always
(https://github.com/confluentinc/kafka-connect-jms/pull/88). Users would need
to manually restart the task to recover from even simple network glitches.
AFAICT from reading code, the same is true for {{WorkerSinkTask}} when calling
{{put()}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
