Thanks, Guozhang Regards,
Libo -----Original Message----- From: Guozhang Wang [mailto:wangg...@gmail.com] Sent: Thursday, August 22, 2013 12:42 PM To: users@kafka.apache.org Subject: Re: issue with kafka-preferred-replica-election.sh Hello Libo, I have created the Jira for this issue: https://issues.apache.org/jira/browse/KAFKA-1019 Guozhang On Wed, Aug 21, 2013 at 11:27 AM, Yu, Libo <libo...@citi.com> wrote: > We never deleted it. Either it was never created or deleted somehow. > > Regards, > > Libo > > > -----Original Message----- > From: Guozhang Wang [mailto:wangg...@gmail.com] > Sent: Wednesday, August 21, 2013 11:41 AM > To: users@kafka.apache.org > Subject: Re: issue with kafka-preferred-replica-election.sh > > Libo, > > Just want to clarify, in your case after you created your topic, the > /brokers/topics/my_topic/partitions was never created or it was > deleted somehow? > > Guozhang > > > > On Wed, Aug 21, 2013 at 7:25 AM, Yu, Libo <libo...@citi.com> wrote: > > > For the path /brokers/topics/my_topic/partitions, if you remove > > partitions and run kafka-preferred-replica-election.sh, it > > terminates right away with keeper exception. > > > > Regards, > > > > Libo > > > > > > -----Original Message----- > > From: Guozhang Wang [mailto:wangg...@gmail.com] > > Sent: Wednesday, August 21, 2013 12:23 AM > > To: users@kafka.apache.org > > Subject: Re: issue with kafka-preferred-replica-election.sh > > > > Libo, > > > > Sorry for the late reply. I will file a JIRA for this one. Could you > > please provide the full process and environment to reproduce this issue? > > > > Guozhang > > > > > > On Tue, Aug 20, 2013 at 1:10 PM, Yu, Libo <libo...@citi.com> wrote: > > > > > Hi Guozhang, > > > > > > Thanks for the detailed reply. All the brokers are running. > > > The path not created is > > > /brokers/topics/uattoqaaa.default/partitions > > > not > > > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state > > > Actually, I found quite a few topics don't have the issue. The > > > controller must have failed to create them. I will keep monitoring > > > this > > issue. > > > > > > Currently, when /brokers/topics/my_path/partitions is not there, > > > kafka-preferred-replica-election.sh stops right away with nonode > > > keeper exception. Could you file a JIRA to make it keep working in > > > that scenario? > > > > > > > > > > > > Regards, > > > > > > Libo > > > > > > > > > -----Original Message----- > > > From: Guozhang Wang [mailto:wangg...@gmail.com] > > > Sent: Tuesday, August 20, 2013 3:56 PM > > > To: users@kafka.apache.org > > > Subject: Re: issue with kafka-preferred-replica-election.sh > > > > > > The create command tool will only create the path > > > /brokers/topics/uattoqaaa.default, and then controller, once > > > noticing the change in ZK about the added topic, will elect > > > leaders from the assigned replicas written in > > > /brokers/topics/uattoqaaa.default and then create > > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state. > > > > > > If you have created the topic for a long time but > > > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state > > > is not created by controller, it could because the replicas > > > specified in /brokers/topics/uattoqaaa.default does not exist yet. > > > Could you verify the brokers specified in this path are up and running? > > > > > > Guozhang > > > > > > > > > On Tue, Aug 20, 2013 at 12:14 PM, Yu, Libo <libo...@citi.com> wrote: > > > > > > > One more question: > > > > "The create topic command will not immediately create the path; > > > > it will be created by the controller later during the creation > > > > of partitions and assign replicas to partitions." > > > > > > > > So when will the controller create the path and partitions? When > > > > the first message is published to the topic and partition? > > > > All the partitions are created at once? > > > > > > > > Regards, > > > > > > > > Libo > > > > > > > > > > > > -----Original Message----- > > > > From: Guozhang Wang [mailto:wangg...@gmail.com] > > > > Sent: Tuesday, August 20, 2013 1:48 PM > > > > To: users@kafka.apache.org > > > > Subject: Re: issue with kafka-preferred-replica-election.sh > > > > > > > > Could you check that before you run > > > > kafka-preferred-replica-election.sh > > > > the /brokers/topics/uattoqaaa.default/partitions Node has been > > > > created or not? > > > > The create topic command will not immediately create the path; > > > > it will be created by the controller later during the creation > > > > of partitions and assign replicas to partitions. If you start > > > > the election command right after the create topic tool, it might > > > > not be > > created yet. > > > > > > > > Guozhang > > > > > > > > > > > > On Tue, Aug 20, 2013 at 10:24 AM, Yu, Libo <libo...@citi.com> wrote: > > > > > > > > > It is created with 3 partitions. > > > > > > > > > > Regards, > > > > > > > > > > Libo > > > > > > > > > > > > > > > -----Original Message----- > > > > > From: Guozhang Wang [mailto:wangg...@gmail.com] > > > > > Sent: Tuesday, August 20, 2013 12:21 PM > > > > > To: users@kafka.apache.org > > > > > Subject: Re: issue with kafka-preferred-replica-election.sh > > > > > > > > > > Hello Libo, > > > > > > > > > > Before you call the kafka-preferred-replica-election.sh have > > > > > you already created the topic uattoqaaa.default with the > > > > > number of > > > > partitions? > > > > > > > > > > Guozhang > > > > > > > > > > > > > > > On Tue, Aug 20, 2013 at 8:35 AM, Yu, Libo <libo...@citi.com> > wrote: > > > > > > > > > > > Hi, > > > > > > > > > > > > I tried to run kafka-preferred-replica-election.sh on our > > > > > > kafka > > > > cluster. > > > > > > But I got this expection: > > > > > > Failed to start preferred replica election > > > > > > org.I0Itec.zkclient.exception.ZkNoNodeException: > > > > > > org.apache.zookeeper.KeeperException$NoNodeException: > > > > > > KeeperErrorCode = NoNode for > > > > > > /brokers/topics/uattoqaaa.default/partitions > > > > > > > > > > > > I checked zookeeper and there is no > > > > > > /brokers/topics/uattoqaaa.default/partitions. All I found is > > > > > > /brokers/topics/uattoqaaa.default. > > > > > > > > > > > > I believe this is a bug and I am not sure if there is a JIRA > > > > > > for > > it. > > > > > > Could you confirm? Thanks. > > > > > > > > > > > > Regards, > > > > > > > > > > > > Libo > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > -- Guozhang > > > > > > > > > > > > > > > > > > > > > -- > > > > -- Guozhang > > > > > > > > > > > > > > > > -- > > > -- Guozhang > > > > > > > > > > > -- > > -- Guozhang > > > > > > -- > -- Guozhang > -- -- Guozhang
