Re: What happens if one broker goes down

2013-05-20 Thread Neha Narkhede
0.7.2 does not support replication. So when a broker goes down, there can be some data loss. If you are ok with duplicates, you can configure the producer side retries to be higher. Thanks, Neha On May 19, 2013 11:32 PM, "Chitra Raveendran" < chitra.raveend...@fluturasolutions.com> wrote: > HI >

Re: What happens if one broker goes down

2013-05-19 Thread Chitra Raveendran
HI When my broker went down, my producer just stopped reading the file giving an exception saying "connection refused to kafka broker". I tried overcoming the exception by giving a try and catch ! BUT I'M SEEING DATA LOSS. What am I doing wrong ??? Please help For reference : I'm using kafka 0.7.

Re: What happens if one broker goes down

2013-05-17 Thread Neha Narkhede
You can read the high level design of kafka replication here http://www.slideshare.net/junrao/kafka-replication-apachecon2013 Generally if your replication factor is more than 1 you shouldn't see data loss in your test. When a broker fails, the producer will get an exception and it will retry. Th

What happens if one broker goes down

2013-05-16 Thread Chitra Raveendran
Hi I was just doing some benchmarking with a 3node cluster. If one broker goes down , what happens? Does the producer go down ? that's what happened in my case. Is the data lost? Or does it get distributed amongst the other brokers? -- Chitra Raveendran Data Scientist *Flutura | Decision Scienc