Re: restarting a broker during partition reassignment

2014-06-25 Thread Guozhang Wang
Kafka should not reset offset to zero by itself, do you see any exceptions on the Zookeeper logs? There are some known bugs on ZK that can cause broker registration node deleted, but I am not sure if some bugs can cause offset reset. Guozhang On Tue, Jun 24, 2014 at 8:44 AM, Luke Forehand < luke

Re: restarting a broker during partition reassignment

2014-06-24 Thread Luke Forehand
My hypothesis for how Partition [luke3,3] with leader 11, had offset reset to zero, caused by reboot of leader broker during partition reassignment: The replicas for [luke3,3] were in progress being reassigned from broker 10,11,12 -> 11,12,13 I rebooted broker 11 which was the leader for [luke3.3

Re: restarting a broker during partition reassignment

2014-06-23 Thread Guozhang Wang
Hi Luke, What are the exceptions/warnings you saw in the broker and controller logs? Guozhang On Mon, Jun 23, 2014 at 2:03 PM, Luke Forehand < luke.foreh...@networkedinsights.com> wrote: > Hello, > > I am testing kafka 0.8.1.1 in preparation for an upgrade from > kafka-0.8.1-beta. I have a 4