Re: Kafka availability guarantee

2015-10-11 Thread Elias Levy
On Sun, Oct 11, 2015 at 2:34 PM, Todd Palino wrote: > To answer the question, yes, it is incorrect. There are a few things you > can do to minimize problems. One is to disable unclean leader election, use > acks=-1 on the producers, have an RF of 3 or greater, and set the min ISR > to 2. This mea

Re: Kafka availability guarantee

2015-10-11 Thread Todd Palino
To answer the question, yes, it is incorrect. There are a few things you can do to minimize problems. One is to disable unclean leader election, use acks=-1 on the producers, have an RF of 3 or greater, and set the min ISR to 2. This means that the topic will only be available if there are at least

Re: Kafka availability guarantee

2015-10-11 Thread todd
You can enable unclean leader election, which would allow the lagging partition to still become leader. There would be some data loss (offsets between the leggy partition and the old leader) but the partition would stay online and available. Sent from my BlackBerry 10 smartphone on the TELUS