You can either try using rmr on zookeeper client 3.4.x (./zkCli.sh rmr /node) or write your own script that does a recursive delete - https://issues.apache.org/jira/browse/ZOOKEEPER-729
Thanks, Neha On Fri, Aug 23, 2013 at 10:52 AM, Yu, Libo <libo...@citi.com> wrote: > I will give it a try. I know how to delete log files. But to delete the > zookeeper data, > do I only need to run the delete script? > > Regards, > > Libo > > > -----Original Message----- > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > Sent: Friday, August 23, 2013 1:43 PM > To: users@kafka.apache.org > Subject: Re: delete a topic > > Without the proper functionality of delete topic, I'm not sure if deleting > the zookeeper and kafka data just for that topic is enough or not. On the > surface, this approach seems sufficient, but I'm not sure of all the > consequences of doing that. Also, remember to bounce the entire cluster > once you've deleted the zookeeper and kafka data for the topic in question. > > Can you give it a try and let us know how it went? > > Thanks, > Neha > > > On Fri, Aug 23, 2013 at 10:15 AM, Yu, Libo <libo...@citi.com> wrote: > > > Hi Neha, > > > > One more questions. Assume I want to delete a topic. When you say > > deleting zookeeper data and kafka data, do you mean deleting zookeeper > > data and kafka data for ALL the topics or only for that particular > > topic? > > > > > > Regards, > > > > Libo > > > > > > -----Original Message----- > > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > > Sent: Friday, August 23, 2013 11:33 AM > > To: users@kafka.apache.org > > Subject: Re: delete a topic > > > > By that, I meant bringing down all brokers, deleting zookeeper data > > and kafka data and restarting the brokers. I suspect attempting a > > delete topic might have caused something bad to happen on the ISR > > side. It will be great if you can start clean and then see if the ISR is > still an issue. > > > > Also, I filed a bug to include a tool that makes it easy to check the > > replica lag and progress, while troubleshooting ISR membership issues > > - > > https://issues.apache.org/jira/browse/KAFKA-1021 > > > > Thanks, > > Neha > > > > > > On Fri, Aug 23, 2013 at 6:34 AM, Yu, Libo <libo...@citi.com> wrote: > > > > > Hi Neha, > > > > > > "Wipe out the cluster" Do you mean you uninstall the cluster and > > > reinstall it? > > > Or you just delete all kafka data and zookeeper data for the cluster? > > > This is not a blocking issue for us. Our blocking issue is that some > > > broker will fall out of ISR and never get back to it. We have > > > observed that from more that one clusters. I am not sure if it is > > > related to the deleting issue. > > > > > > Regards, > > > > > > Libo > > > > > > > > > -----Original Message----- > > > From: Neha Narkhede [mailto:neha.narkh...@gmail.com] > > > Sent: Thursday, August 22, 2013 5:01 PM > > > To: users@kafka.apache.org > > > Subject: Re: delete a topic > > > > > > In production, we are not deleting topics yet. In test environments, > > > if we have to delete topics, we wipe out the cluster. If this is a > > > feature that most users are blocked on, I think it makes sense to > > > prioritize https://issues.apache.org/jira/browse/KAFKA-330. > > > > > > Thanks, > > > Neha > > > > > > > > > On Thu, Aug 22, 2013 at 1:01 PM, Vadim Keylis > > > <vkeylis2...@gmail.com> > > > wrote: > > > > > > > How do you guys delete a topic if such need arise? > > > > > > > > > > > > On Thu, Aug 22, 2013 at 12:29 PM, Neha Narkhede > > > > <neha.narkh...@gmail.com > > > > >wrote: > > > > > > > > > I mentioned this in a different thread. I think the > > > > 0.8.0-beta1-candidate1 > > > > > includes the script, but we have removed it later. I think when > > > > > we > > > > publish > > > > > 0.8-final, this should be resolved. > > > > > > > > > > Thanks, > > > > > Neha > > > > > > > > > > > > > > > On Thu, Aug 22, 2013 at 12:24 PM, Neha Narkhede > > > > > <neha.narkh...@gmail.com > > > > > >wrote: > > > > > > > > > > > Vadim, > > > > > > > > > > > > The JIRA tracking this feature is > > > > > > https://issues.apache.org/jira/browse/KAFKA-330. > > > > > > Until we have this feature, we should remove any scripts that > > > > > > give the impression of deleting a topic, as Jay suggested. I > > > > > > tried looking under bin/ but couldn't find any delete topic or > > > > > > partition > > > script. > > > > > > > > > > > > Can you tell us which script you are using? > > > > > > > > > > > > Thanks, > > > > > > Neha > > > > > > > > > > > > > > > > > > On Thu, Aug 22, 2013 at 11:40 AM, Vadim Keylis > > > > > ><vkeylis2...@gmail.com > > > > > >wrote: > > > > > > > > > > > >> Jay or Neha. What is the process of deleting the topic if the > > > > > >> script included in the repository creates false impression? > > > > > >> > > > > > >> Thanks, > > > > > >> Vadim > > > > > >> > > > > > >> > > > > > >> On Thu, Aug 22, 2013 at 11:14 AM, Jay Kreps > > > > > >> <jay.kr...@gmail.com> > > > > > wrote: > > > > > >> > > > > > >> > We should really remove the delete script from 0.8 if we > > > > > >> > plan to > > > > > release > > > > > >> > without delete support. Right now it appears to work but > > > > > >> > doesn't > > > > which > > > > > >> is > > > > > >> > clearly not good. > > > > > >> > > > > > > >> > -Jay > > > > > >> > > > > > > >> > > > > > > >> > On Thu, Aug 22, 2013 at 10:57 AM, Neha Narkhede < > > > > > >> neha.narkh...@gmail.com > > > > > >> > >wrote: > > > > > >> > > > > > > >> > > We currently don't have the delete topic feature in Kafka > > > > > >> > > 0.8. So > > > > > any > > > > > >> > > manual attempts to do so might have a negative impact on > > > > > >> functionality. > > > > > >> > > > > > > > >> > > Thanks, > > > > > >> > > Neha > > > > > >> > > > > > > > >> > > > > > > > >> > > On Thu, Aug 22, 2013 at 10:30 AM, Yu, Libo > > > > > >> > > <libo...@citi.com> > > > > > wrote: > > > > > >> > > > > > > > >> > > > Hi team, > > > > > >> > > > > > > > > >> > > > When I delete a topic, the topic is deleted from > > > > > >> > > > zookeeper but > > > > its > > > > > >> log > > > > > >> > > > files are not deleted from Brokers. > > > > > >> > > > > > > > > >> > > > When I restart a broker, the broker will try to sync > > > > > >> > > > the log > > > > > files > > > > > >> > whose > > > > > >> > > > topic has been deleted. > > > > > >> > > > Manually deleting the log files will resolve the issue. > > > > > >> > > > Should > > > > > >> broker > > > > > >> > > > ignore log files whose topic has been deleted? > > > > > >> > > > > > > > > >> > > > Regards, > > > > > >> > > > > > > > > >> > > > Libo > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > >
