Re: High-Level Consumer and peeking messages

2014-04-14 Thread Guozhang Wang
Hi Paul, This will work if you cares about not losing any non-processed messages, but not about messages-being-processed twice. Say you have a failure after process(...) and before it.next(), on recovery the same message will be processed again. I agree that the cross-thread commit() in the 0.8

High-Level Consumer and peeking messages

2014-04-14 Thread Paul Mogren
Hello, I am excited to be trying out Kafka. It sounds like everything I ever wanted in a messaging system, but didn't have. I am interested in using the High-Level Consumer without losing (consuming) messages that were read from the broker, but not processed by user code (exception thrown, dat