Re: Async and error handling

2013-10-07 Thread Neha Narkhede
The async producer's send() API is never supposed to block. If, for some reason, the producer's queue is full and you try to send more messages, it will drop those messages and raise a QueueFullException. You can configure the "message.send.max.retries" config to retry sending the messages n times,

Re: Async and error handling

2013-10-07 Thread Bruno D. Rodrigues
So the concept to keep in mind is that as long as we set the whole kafka servers list on the producer and the zookeeper(s) list on the consumers, from a producer and consumer's perspective it should just work and the code won't get any information, but instead one should look at the logs? What

Re: Async and error handling

2013-10-07 Thread Neha Narkhede
Kafka never had a callback for the async producer yet. But this is proposed for Kafka 0.9. You can find the proposal here - https://cwiki.apache.org/confluence/display/KAFKA/Client+Rewrite#ClientRewrite-ProposedProducerAPI Thanks, Neha On Oct 7, 2013 4:52 AM, "Bruno D. Rodrigues" wrote: > Apolog

Async and error handling

2013-10-07 Thread Bruno D. Rodrigues
Apologise in advance if it's a dummy or common question but as usual I couldn't yet find the answer anywhere to it. How can we setup some kind of handler to catch async errors? Let's say something as simple as this: final Properties props = new Properties(); props.put("metadata.