By that, I meant bringing down all brokers, deleting zookeeper data and kafka data and restarting the brokers. I suspect attempting a delete topic might have caused something bad to happen on the ISR side. It will be great if you can start clean and then see if the ISR is still an issue.
Also, I filed a bug to include a tool that makes it easy to check the replica lag and progress, while troubleshooting ISR membership issues - https://issues.apache.org/jira/browse/KAFKA-1021 Thanks, Neha On Fri, Aug 23, 2013 at 6:34 AM, Yu, Libo <libo...@citi.com> wrote: > Hi Neha, > > "Wipe out the cluster" Do you mean you uninstall the cluster and reinstall > it? > Or you just delete all kafka data and zookeeper data for the cluster? > This is not a blocking issue for us. Our blocking issue is that some > broker will > fall out of ISR and never get back to it. We have observed that from more > that one clusters. I am not sure if it is related to the deleting issue. > > Regards, > > Libo > > > -----Original Message----- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Thursday, August 22, 2013 5:01 PM > To: users@kafka.apache.org > Subject: Re: delete a topic > > In production, we are not deleting topics yet. In test environments, if we > have to delete topics, we wipe out the cluster. If this is a feature that > most users are blocked on, I think it makes sense to prioritize > https://issues.apache.org/jira/browse/KAFKA-330. > > Thanks, > Neha > > > On Thu, Aug 22, 2013 at 1:01 PM, Vadim Keylis <vkeylis2...@gmail.com> > wrote: > > > How do you guys delete a topic if such need arise? > > > > > > On Thu, Aug 22, 2013 at 12:29 PM, Neha Narkhede > > <neha.narkh...@gmail.com > > >wrote: > > > > > I mentioned this in a different thread. I think the > > 0.8.0-beta1-candidate1 > > > includes the script, but we have removed it later. I think when we > > publish > > > 0.8-final, this should be resolved. > > > > > > Thanks, > > > Neha > > > > > > > > > On Thu, Aug 22, 2013 at 12:24 PM, Neha Narkhede > > > <neha.narkh...@gmail.com > > > >wrote: > > > > > > > Vadim, > > > > > > > > The JIRA tracking this feature is > > > > https://issues.apache.org/jira/browse/KAFKA-330. > > > > Until we have this feature, we should remove any scripts that give > > > > the impression of deleting a topic, as Jay suggested. I tried > > > > looking under bin/ but couldn't find any delete topic or partition > script. > > > > > > > > Can you tell us which script you are using? > > > > > > > > Thanks, > > > > Neha > > > > > > > > > > > > On Thu, Aug 22, 2013 at 11:40 AM, Vadim Keylis > > > ><vkeylis2...@gmail.com > > > >wrote: > > > > > > > >> Jay or Neha. What is the process of deleting the topic if the > > > >> script included in the repository creates false impression? > > > >> > > > >> Thanks, > > > >> Vadim > > > >> > > > >> > > > >> On Thu, Aug 22, 2013 at 11:14 AM, Jay Kreps <jay.kr...@gmail.com> > > > wrote: > > > >> > > > >> > We should really remove the delete script from 0.8 if we plan > > > >> > to > > > release > > > >> > without delete support. Right now it appears to work but > > > >> > doesn't > > which > > > >> is > > > >> > clearly not good. > > > >> > > > > >> > -Jay > > > >> > > > > >> > > > > >> > On Thu, Aug 22, 2013 at 10:57 AM, Neha Narkhede < > > > >> neha.narkh...@gmail.com > > > >> > >wrote: > > > >> > > > > >> > > We currently don't have the delete topic feature in Kafka > > > >> > > 0.8. So > > > any > > > >> > > manual attempts to do so might have a negative impact on > > > >> functionality. > > > >> > > > > > >> > > Thanks, > > > >> > > Neha > > > >> > > > > > >> > > > > > >> > > On Thu, Aug 22, 2013 at 10:30 AM, Yu, Libo <libo...@citi.com> > > > wrote: > > > >> > > > > > >> > > > Hi team, > > > >> > > > > > > >> > > > When I delete a topic, the topic is deleted from zookeeper > > > >> > > > but > > its > > > >> log > > > >> > > > files are not deleted from > > > >> > > > Brokers. > > > >> > > > > > > >> > > > When I restart a broker, the broker will try to sync the > > > >> > > > log > > > files > > > >> > whose > > > >> > > > topic has been deleted. > > > >> > > > Manually deleting the log files will resolve the issue. > > > >> > > > Should > > > >> broker > > > >> > > > ignore log files whose topic has been deleted? > > > >> > > > > > > >> > > > Regards, > > > >> > > > > > > >> > > > Libo > > > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > > > > > > > > > > >
