Mark, what database are you using?
If you are using MySQL...
There is a not-yet-finished Kafka MySQL Connector at
https://github.com/wushujames/kafka-mysql-connector. It tails the MySQL binlog,
and so will handle the situation you describe.
But, as I mentioned, I haven't finished it yet.
If
Ewen,
Thanks for the reply. We'll proceed while keeping all of your points in
mind. I looked around for a more focused forum for the jdbc connector
before posting here but didn't come across the confluent-platform group.
I'll direct any more questions about the jdbc connector there. I'll also
c
Mark,
There are definitely limitations to using JDBC for change data capture.
Using a database-specific implementation, especially if you can read
directly off the database's log, will be able to handle more situations
like this. Cases like the one you describe are difficult to address
efficiently
I had asked this in a github issue but I'm reposting here to try and get an
answer from a wider audience.
Has any thought gone into how kafka-connect-jdbc will be impacted by SQL
transactions committing IDs and timestamps out-of-order? Let me give an
example with two connections.
1: begin transa
