Hi all, I just posted KIP-26 - Add Copycat, a connector framework for data import/export here: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals
This is a large KIP compared to what we've had so far, and is a bit different from most. We're proposing the addition of a fairly big new component to Kafka because we think including it as part of Kafka rather than as an external project is in the best interest of both Copycat and Kafka itself. The goal with this KIP is to decide whether such a tool would make sense in Kafka, give a high level sense of what it would entail, and scope what would be included vs what would be left to third-parties. I'm hoping to leave discussion of specific design and implementation details, as well logistics like how best to include it in the Kafka repository & project, to the subsequent JIRAs or follow up KIPs. Looking forward to your feedback! -Ewen P.S. Preemptive relevant XKCD: https://xkcd.com/927/