A couple of folks have been thinking through adding transactional support to Kafka - close to, but much more general than the idempotent producer. Rather than put too many details in this email I thought I would send out a wiki link to the write-up and proposal:
https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka It will require (mainly additions) to the client APIs and to the on-disk message format - will add more details on the changes to the wiki. It would be great if people can take a look and provide any early feedback. I created a separate branch (transactional_messaging) off trunk to work on an implementation based off that proposal. Thanks, Joel
