Richard, KAFKA-156 is something that the client could take care of. It is 2 years old and a bit of a hack suggestion for what Replication in 0.8.0 has become and I would argue we close it (we should go through all the ticket prior to 0.9 and chat about them, separate thread I will start on dev). Replication solves the problem stated in the ticket as messages are NOT dropped with brokers unavailable.
The documentation for replication is here http://kafka.apache.org/documentation.html#replication /******************************************* Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> ********************************************/ On Fri, Nov 1, 2013 at 9:30 AM, Richard Rodseth <rrods...@gmail.com> wrote: > I'm excited about Kafka but want to be sure it is ready (or will be soon) > for a critical data pipeline. > > What are the showstoppers, if any? eg. > > https://issues.apache.org/jira/browse/KAFKA-156 > > mentioned here: > > > http://stackoverflow.com/questions/12130481/is-kafka-ready-for-production-use/12764663#12764663 > > I've looked at this list: > https://cwiki.apache.org/confluence/display/KAFKA/Powered+By > > Comments? >