Re: Questions about failure recovery, load balancing and producer ack/async mode

2013-10-23 Thread Jun Rao
1,3 Take a look at request.required.acks in http://kafka.apache.org/documentation.html#producerconfigs 2. The producer does random distribution by default. However, you can provide a partitioning key and a partitioning function. For details on how consumer load balancing works, see http://research

Questions about failure recovery, load balancing and producer ack/async mode

2013-10-23 Thread Shafaq
Hi, Following need more elaboration after reading kafka docs: 1- In a scenario during leader fails over, what happens to messages that are not committed to other followers and to the messages that producer keep in sending (in async mode) till new leader is elected. Can the producer buffer thes