Hi all,

Sink connectors support Dear Letter Queues[1], but Source connectors don't seem 
to

What is the reason that we decided to do that?

In my data pipeline, I'd like to apply some transformations to the messages 
before they are sink, but that leaves me vulnerable to failures as I need to 
either fail the connector or employ logging to track source failures

It seems that for now, I'll need to apply the transformations as a sink and 
possibly reinsert them back to Kafka for downstream consumption, but that 
sounds unnecessary 


[1]https://cwiki.apache.org/confluence/plugins/servlet/mobile?contentId=80453065#content/view/80453065

Reply via email to