0.7.2 does not support replication. So when a broker goes down, there can
be some data loss. If you are ok with duplicates, you can configure the
producer side retries to be higher.
Thanks,
Neha
On May 19, 2013 11:32 PM, "Chitra Raveendran" <
chitra.raveend...@fluturasolutions.com> wrote:
> HI
>
HI
When my broker went down, my producer just stopped reading the file giving
an exception saying "connection refused to kafka broker".
I tried overcoming the exception by giving a try and catch ! BUT I'M SEEING
DATA LOSS. What am I doing wrong ??? Please help
For reference :
I'm using kafka 0.7.
You can read the high level design of kafka replication here
http://www.slideshare.net/junrao/kafka-replication-apachecon2013
Generally if your replication factor is more than 1 you shouldn't see data
loss in your test. When a broker fails, the producer will get an exception
and it will retry.
Th
Hi
I was just doing some benchmarking with a 3node cluster. If one broker goes
down , what happens? Does the producer go down ? that's what happened in my
case.
Is the data lost? Or does it get distributed amongst the other brokers?
--
Chitra Raveendran
Data Scientist
*Flutura | Decision Scienc