Re: New producer and ordering of Callbacks when sending to multiple partitions

2015-07-13 Thread Gwen Shapira
James, There are separate queues for each partition, so there are no guarantees on the order of the sends (or callbacks) between partitions. (Actually, IIRC, the code intentionally randomizes the partition order a bit, possibly to avoid starvation) Gwen On Mon, Jul 13, 2015 at 5:41 PM, James Che

New producer and ordering of Callbacks when sending to multiple partitions

2015-07-13 Thread James Cheng
Hi, I'm trying to understand the new producer, and the order in which the Callbacks will be called. From my understanding, records are batched up per partition. So all records destined for a specific partition will be sent in order, and that means that their callbacks will be called in order.