On 2/21/16 10:23 AM, Jay Kreps wrote:
Hey Andrew,
Yeah I think the current state is that we did several design and prototypes
(both the transaction work and the idempotence design and the conditional
write KIP), but none of these offshoots is really fully rationalized with
the other ones. Slow progress in this area has been mainly due to time
constraints--no one working on it full time. We're interested in picking up
the work at Confluent and hope to get some design ideas out on wiki for
discussion in the next month or so.
I'm also very interested in this. I'm using Kafka to publish Golden
Gate changes, and am working on my own code to skip over potentially
duplicate messages. I'll soon start working on the same task for
MySQL/Aurora.
One goal of the system I'm working on is to allow numerous
organizations to access the same database change logs via Kafka
rather than by the numerous proprietary systems that do this.
Mark
