Re: Loss of Leader in Kafka

2014-05-18 Thread Rob
What is the best practice for doing so? Thanks Rob On May 16, 2014, at 12:55 PM, Neha Narkhede wrote: >>> Am I right with the above? > > That is the hacky way of deleting a topic and has not been well tested and > hence is not certified to work. There are also several race conditions in > the

Re: Loss of Leader in Kafka

2014-05-16 Thread Neha Narkhede
>> Am I right with the above? That is the hacky way of deleting a topic and has not been well tested and hence is not certified to work. There are also several race conditions in the steps above where the controller can keep overwriting the data deleted in zookeeper. So again, delete topic require

Re: Loss of Leader in Kafka

2014-05-16 Thread Kashyap Mhaisekar
Hi Neha/Jun, A kafa topic deletion involves - 1. Zookeeper clean up (Nodes in zookeeper clusters to be removed - one under brokers/ and other where the offset info is stored) 2. kafka data logs to cleared on each server in cluster for the topic to be deleted 3. partition and replication data to be

Re: Loss of Leader in Kafka

2014-05-13 Thread Kashyap Mhaisekar
After topic deletion, I deleted the physical folders in data logs and then restarted Kafka. That resolved. Thanks! Will try out 0.8.1 and let the group know. Regards, Kashyap On Monday, May 12, 2014, Jun Rao wrote: > Delete topic doesn't quite work in 0.8.1. We recently fixed it in trunk. > Cou

Re: Loss of Leader in Kafka

2014-05-13 Thread Guozhang Wang
Hi Kashyap, This may be a real issue with delete-topic feature, could you also reproduce this with trunk HEAD and 1 partition/1 replica? Guozhang On Mon, May 12, 2014 at 9:39 AM, Kashyap Mhaisekar wrote: > Hi, > I am hitting a strange exception while creating a topic in Kafka - > Steps to gene

Re: Loss of Leader in Kafka

2014-05-13 Thread Neha Narkhede
>> 3. Deleted the topic. Checked only the zookeeper to see if the /brokers/topics DOES NOT have the topic You are seeing this problem since delete topic is not supported in Kafka. Any attempt to delete a topic may leave your cluster in an unstable state. We plan to release 0.8.2 with delete topic

Re: Loss of Leader in Kafka

2014-05-12 Thread Jun Rao
Delete topic doesn't quite work in 0.8.1. We recently fixed it in trunk. Could you give it a try and see if you see the same issue? Thanks, Jun On Mon, May 12, 2014 at 9:39 AM, Kashyap Mhaisekar wrote: > Hi, > I am hitting a strange exception while creating a topic in Kafka - > Steps to genera

Loss of Leader in Kafka

2014-05-12 Thread Kashyap Mhaisekar
Hi, I am hitting a strange exception while creating a topic in Kafka - Steps to generate this- 1. Created a topic multipartition_test with 2 partitions and 2 replicas 2. Added some data to this topics and verified data is coming up for both partitions 3. Deleted the topic. Checked only the zookeepe