[
https://issues.apache.org/jira/browse/KAFKA-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gunnar Morling updated KAFKA-7336:
----------------------------------
Summary: Kafka Connect source task hangs when producing record with invalid
topic name (was: Kafka Connect source task when producing record with invalid
topic name)
> Kafka Connect source task hangs when producing record with invalid topic name
> -----------------------------------------------------------------------------
>
> Key: KAFKA-7336
> URL: https://issues.apache.org/jira/browse/KAFKA-7336
> Project: Kafka
> Issue Type: Bug
> Components: KafkaConnect
> Affects Versions: 2.0.0
> Reporter: Gunnar Morling
> Priority: Major
>
> If a Kafka Connect source task returns a {{SourceRecord}} with an invalid
> topic name (e.g. "dbserver1.inventory.test@data"), that source task hangs
> (presumably indefinitely?) and doesn't continue it's polling loop. The log is
> flooded with this message:
> {code}
> connect_1 | 2018-08-24 08:47:29,014 WARN || [Producer
> clientId=producer-4] Error while fetching metadata with correlation id 833 :
> {dbserver1.inventory.test@data=INVALID_TOPIC_EXCEPTION}
> [org.apache.kafka.clients.NetworkClient]
> {code}
> The producer thread is stuck in the loop here:
> {code}
> KafkaProducer<K,V>.waitOnMetadata(String, Integer, long) line: 938
> KafkaProducer<K,V>.doSend(ProducerRecord<K,V>, Callback) line: 823
> KafkaProducer<K,V>.send(ProducerRecord<K,V>, Callback) line: 803
> WorkerSourceTask.sendRecords() line: 318
> WorkerSourceTask.execute() line: 228
> WorkerSourceTask(WorkerTask).doRun() line: 175
> WorkerSourceTask(WorkerTask).run() line: 219
> Executors$RunnableAdapter<T>.call() line: 511
> FutureTask<V>.run() line: 266
> ThreadPoolExecutor.runWorker(ThreadPoolExecutor$Worker) line: 1149
> ThreadPoolExecutor$Worker.run() line: 624
> Thread.run() line: 748
> {code}
> This causes the task to remain in RUNNING state, but no further invocations
> of {{poll()}} are done.
> Of course we'll work around this and make sure to not produce records with
> invalid topic names, but I think the source task should transition to FAILED
> state in this case.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
