KafkaProducer.send contract

2015-02-17 Thread JAmes Atwill
Hi! I'm using the new KafkaProducer in 0.8.2.0. I have thousands of "Nodes" which receive messages. Each message idempotently mutates the state of the Node, so while duplicate messages are fine, missed messages are not. I'm writing these messages into a topic with dozens of partitions. Am I cor

Re: KafkaProducer.send contract

2015-02-19 Thread JAmes Atwill
h multiple messages for a particular Node)? JAmes On Thu, Feb 19, 2015 at 2:50 PM, Jun Rao wrote: > You can register a callback for each message sent. The callback will be > called when the message is sent successfully or failed. > > Thanks, > > Jun > > On Tue, Feb 17,

Re: KafkaProducer.send contract

2015-02-24 Thread JAmes Atwill
to track the failure state too. JAmes On Mon, Feb 23, 2015 at 4:36 PM, Jun Rao wrote: > Could you explain a bit more what you want to achieve through batching? > Better throughput or atomicity? > > Thanks, > > Jun > > On Thu, Feb 19, 2015 at 4:09 PM, JAmes Atwill >