Search for *-ConsumerLag under kafka.server. There is a jmx bean per partition in the follower.
Thanks, Jun On Fri, Aug 23, 2013 at 7:59 PM, Vadim Keylis <vkeylis2...@gmail.com> wrote: > Hi Neha. What are jmx properties to monitor for lag and progress of > replica, until you release the tool? > > Sent from my iPhone > > On Aug 23, 2013, at 8:32 AM, Neha Narkhede <neha.narkh...@gmail.com> > wrote: > > > By that, I meant bringing down all brokers, deleting zookeeper data and > > kafka data and restarting the brokers. I suspect attempting a delete > topic > > might have caused something bad to happen on the ISR side. It will be > great > > if you can start clean and then see if the ISR is still an issue. > > > > Also, I filed a bug to include a tool that makes it easy to check the > > replica lag and progress, while troubleshooting ISR membership issues - > > https://issues.apache.org/jira/browse/KAFKA-1021 > > > > Thanks, > > Neha > > > > > > On Fri, Aug 23, 2013 at 6:34 AM, Yu, Libo <libo...@citi.com> wrote: > > > >> Hi Neha, > >> > >> "Wipe out the cluster" Do you mean you uninstall the cluster and > reinstall > >> it? > >> Or you just delete all kafka data and zookeeper data for the cluster? > >> This is not a blocking issue for us. Our blocking issue is that some > >> broker will > >> fall out of ISR and never get back to it. We have observed that from > more > >> that one clusters. I am not sure if it is related to the deleting issue. > >> > >> Regards, > >> > >> Libo > >> > >> > >> -----Original Message----- > >> From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > >> Sent: Thursday, August 22, 2013 5:01 PM > >> To: users@kafka.apache.org > >> Subject: Re: delete a topic > >> > >> In production, we are not deleting topics yet. In test environments, if > we > >> have to delete topics, we wipe out the cluster. If this is a feature > that > >> most users are blocked on, I think it makes sense to prioritize > >> https://issues.apache.org/jira/browse/KAFKA-330. > >> > >> Thanks, > >> Neha > >> > >> > >> On Thu, Aug 22, 2013 at 1:01 PM, Vadim Keylis <vkeylis2...@gmail.com> > >> wrote: > >> > >>> How do you guys delete a topic if such need arise? > >>> > >>> > >>> On Thu, Aug 22, 2013 at 12:29 PM, Neha Narkhede > >>> <neha.narkh...@gmail.com > >>>> wrote: > >>> > >>>> I mentioned this in a different thread. I think the > >>> 0.8.0-beta1-candidate1 > >>>> includes the script, but we have removed it later. I think when we > >>> publish > >>>> 0.8-final, this should be resolved. > >>>> > >>>> Thanks, > >>>> Neha > >>>> > >>>> > >>>> On Thu, Aug 22, 2013 at 12:24 PM, Neha Narkhede > >>>> <neha.narkh...@gmail.com > >>>>> wrote: > >>>> > >>>>> Vadim, > >>>>> > >>>>> The JIRA tracking this feature is > >>>>> https://issues.apache.org/jira/browse/KAFKA-330. > >>>>> Until we have this feature, we should remove any scripts that give > >>>>> the impression of deleting a topic, as Jay suggested. I tried > >>>>> looking under bin/ but couldn't find any delete topic or partition > >> script. > >>>>> > >>>>> Can you tell us which script you are using? > >>>>> > >>>>> Thanks, > >>>>> Neha > >>>>> > >>>>> > >>>>> On Thu, Aug 22, 2013 at 11:40 AM, Vadim Keylis > >>>>> <vkeylis2...@gmail.com > >>>>> wrote: > >>>>> > >>>>>> Jay or Neha. What is the process of deleting the topic if the > >>>>>> script included in the repository creates false impression? > >>>>>> > >>>>>> Thanks, > >>>>>> Vadim > >>>>>> > >>>>>> > >>>>>> On Thu, Aug 22, 2013 at 11:14 AM, Jay Kreps <jay.kr...@gmail.com> > >>>> wrote: > >>>>>> > >>>>>>> We should really remove the delete script from 0.8 if we plan > >>>>>>> to > >>>> release > >>>>>>> without delete support. Right now it appears to work but > >>>>>>> doesn't > >>> which > >>>>>> is > >>>>>>> clearly not good. > >>>>>>> > >>>>>>> -Jay > >>>>>>> > >>>>>>> > >>>>>>> On Thu, Aug 22, 2013 at 10:57 AM, Neha Narkhede < > >>>>>> neha.narkh...@gmail.com > >>>>>>>> wrote: > >>>>>>> > >>>>>>>> We currently don't have the delete topic feature in Kafka > >>>>>>>> 0.8. So > >>>> any > >>>>>>>> manual attempts to do so might have a negative impact on > >>>>>> functionality. > >>>>>>>> > >>>>>>>> Thanks, > >>>>>>>> Neha > >>>>>>>> > >>>>>>>> > >>>>>>>> On Thu, Aug 22, 2013 at 10:30 AM, Yu, Libo <libo...@citi.com> > >>>> wrote: > >>>>>>>> > >>>>>>>>> Hi team, > >>>>>>>>> > >>>>>>>>> When I delete a topic, the topic is deleted from zookeeper > >>>>>>>>> but > >>> its > >>>>>> log > >>>>>>>>> files are not deleted from > >>>>>>>>> Brokers. > >>>>>>>>> > >>>>>>>>> When I restart a broker, the broker will try to sync the > >>>>>>>>> log > >>>> files > >>>>>>> whose > >>>>>>>>> topic has been deleted. > >>>>>>>>> Manually deleting the log files will resolve the issue. > >>>>>>>>> Should > >>>>>> broker > >>>>>>>>> ignore log files whose topic has been deleted? > >>>>>>>>> > >>>>>>>>> Regards, > >>>>>>>>> > >>>>>>>>> Libo > >> >
