Re: Manual Leader Assignment

2014-09-09 Thread Jun Rao
With ack=1, some acked msgs could be lost when the leader of a partition changes. Thanks, Jun On Tue, Sep 9, 2014 at 6:22 AM, Andrew Otto wrote: > > (2) > > configure enough retries + backoff time in the producer (so that new > > leaders can be elected during failure). > Ya, I’ve been doing th

Re: Manual Leader Assignment

2014-09-09 Thread Andrew Otto
> (2) > configure enough retries + backoff time in the producer (so that new > leaders can be elected during failure). Ya, I’ve been doing this, I need to get it just right. > (1) use ack=-1 in the producer; We use ack=1. If I configure (2) properly, I shouldn’t need ack=-1, will I? I don’t th

Re: Manual Leader Assignment

2014-09-08 Thread Jun Rao
To avoid data loss, you will need to (1) use ack=-1 in the producer; (2) configure enough retries + backoff time in the producer (so that new leaders can be elected during failure). For controlled failure, you can reduce the unavailability window by using controlled shutdown. See http://kafka.apac