Hi Neha. What are jmx properties to monitor for lag and progress of replica, until you release the tool?
Sent from my iPhone On Aug 23, 2013, at 8:32 AM, Neha Narkhede <neha.narkh...@gmail.com> wrote: > By that, I meant bringing down all brokers, deleting zookeeper data and > kafka data and restarting the brokers. I suspect attempting a delete topic > might have caused something bad to happen on the ISR side. It will be great > if you can start clean and then see if the ISR is still an issue. > > Also, I filed a bug to include a tool that makes it easy to check the > replica lag and progress, while troubleshooting ISR membership issues - > https://issues.apache.org/jira/browse/KAFKA-1021 > > Thanks, > Neha > > > On Fri, Aug 23, 2013 at 6:34 AM, Yu, Libo <libo...@citi.com> wrote: > >> Hi Neha, >> >> "Wipe out the cluster" Do you mean you uninstall the cluster and reinstall >> it? >> Or you just delete all kafka data and zookeeper data for the cluster? >> This is not a blocking issue for us. Our blocking issue is that some >> broker will >> fall out of ISR and never get back to it. We have observed that from more >> that one clusters. I am not sure if it is related to the deleting issue. >> >> Regards, >> >> Libo >> >> >> -----Original Message----- >> From: Neha Narkhede [mailto:neha.narkh...@gmail.com] >> Sent: Thursday, August 22, 2013 5:01 PM >> To: users@kafka.apache.org >> Subject: Re: delete a topic >> >> In production, we are not deleting topics yet. In test environments, if we >> have to delete topics, we wipe out the cluster. If this is a feature that >> most users are blocked on, I think it makes sense to prioritize >> https://issues.apache.org/jira/browse/KAFKA-330. >> >> Thanks, >> Neha >> >> >> On Thu, Aug 22, 2013 at 1:01 PM, Vadim Keylis <vkeylis2...@gmail.com> >> wrote: >> >>> How do you guys delete a topic if such need arise? >>> >>> >>> On Thu, Aug 22, 2013 at 12:29 PM, Neha Narkhede >>> <neha.narkh...@gmail.com >>>> wrote: >>> >>>> I mentioned this in a different thread. I think the >>> 0.8.0-beta1-candidate1 >>>> includes the script, but we have removed it later. I think when we >>> publish >>>> 0.8-final, this should be resolved. >>>> >>>> Thanks, >>>> Neha >>>> >>>> >>>> On Thu, Aug 22, 2013 at 12:24 PM, Neha Narkhede >>>> <neha.narkh...@gmail.com >>>>> wrote: >>>> >>>>> Vadim, >>>>> >>>>> The JIRA tracking this feature is >>>>> https://issues.apache.org/jira/browse/KAFKA-330. >>>>> Until we have this feature, we should remove any scripts that give >>>>> the impression of deleting a topic, as Jay suggested. I tried >>>>> looking under bin/ but couldn't find any delete topic or partition >> script. >>>>> >>>>> Can you tell us which script you are using? >>>>> >>>>> Thanks, >>>>> Neha >>>>> >>>>> >>>>> On Thu, Aug 22, 2013 at 11:40 AM, Vadim Keylis >>>>> <vkeylis2...@gmail.com >>>>> wrote: >>>>> >>>>>> Jay or Neha. What is the process of deleting the topic if the >>>>>> script included in the repository creates false impression? >>>>>> >>>>>> Thanks, >>>>>> Vadim >>>>>> >>>>>> >>>>>> On Thu, Aug 22, 2013 at 11:14 AM, Jay Kreps <jay.kr...@gmail.com> >>>> wrote: >>>>>> >>>>>>> We should really remove the delete script from 0.8 if we plan >>>>>>> to >>>> release >>>>>>> without delete support. Right now it appears to work but >>>>>>> doesn't >>> which >>>>>> is >>>>>>> clearly not good. >>>>>>> >>>>>>> -Jay >>>>>>> >>>>>>> >>>>>>> On Thu, Aug 22, 2013 at 10:57 AM, Neha Narkhede < >>>>>> neha.narkh...@gmail.com >>>>>>>> wrote: >>>>>>> >>>>>>>> We currently don't have the delete topic feature in Kafka >>>>>>>> 0.8. So >>>> any >>>>>>>> manual attempts to do so might have a negative impact on >>>>>> functionality. >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Neha >>>>>>>> >>>>>>>> >>>>>>>> On Thu, Aug 22, 2013 at 10:30 AM, Yu, Libo <libo...@citi.com> >>>> wrote: >>>>>>>> >>>>>>>>> Hi team, >>>>>>>>> >>>>>>>>> When I delete a topic, the topic is deleted from zookeeper >>>>>>>>> but >>> its >>>>>> log >>>>>>>>> files are not deleted from >>>>>>>>> Brokers. >>>>>>>>> >>>>>>>>> When I restart a broker, the broker will try to sync the >>>>>>>>> log >>>> files >>>>>>> whose >>>>>>>>> topic has been deleted. >>>>>>>>> Manually deleting the log files will resolve the issue. >>>>>>>>> Should >>>>>> broker >>>>>>>>> ignore log files whose topic has been deleted? >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> >>>>>>>>> Libo >>
