Hi, Nice idea, but you could maximise compatibility if you adhere to XA standard APIs rather than Kafka internal APIs.
We at Atomikos offer 2PC coordination and recovery and we are happy to help you design this, it's a service we usually offer for free to backend vendors / systems. Let me know if you'd like to explore? Guy On 2023/08/17 06:39:57 Artem Livshits wrote: > Hello, > > This is a discussion thread for > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-939%3A+Support+Participation+in+2PC > . > > The KIP proposes extending Kafka transaction support (that already uses 2PC > under the hood) to enable atomicity of dual writes to Kafka and an external > database, and helps to fix a long standing Flink issue. > > An example of code that uses the dual write recipe with JDBC and should > work for most SQL databases is here > https://github.com/apache/kafka/pull/14231. > > The FLIP for the sister fix in Flink is here > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=255071710 > > -Artem Sent with Spark
