Re: Kafka topic deletion still not working well

2016-03-13 Thread Stevo Slavić
Created https://issues.apache.org/jira/browse/KAFKA-3389 and https://issues.apache.org/jira/browse/KAFKA-3390 On Sun, Mar 13, 2016 at 10:11 AM, Stevo Slavić wrote: > Is it normal/expected behavior during topic deletion that to-be-deleted > topic partitions ISR will get updated/shrink as replicas

Re: Kafka topic deletion still not working well

2016-03-13 Thread Stevo Slavić
Is it normal/expected behavior during topic deletion that to-be-deleted topic partitions ISR will get updated/shrink as replicas remove fetcher and delete partition log? On Fri, Mar 11, 2016 at 5:32 PM, Stevo Slavić wrote: > Didn't finish sentence, wanted to change font but managed to hit Send >

Re: Kafka topic deletion still not working well

2016-03-11 Thread Stevo Slavić
Didn't finish sentence, wanted to change font but managed to hit Send button instead... As you can see from [1] replica server.log fragment, replica had one state in cache, while actual in ZK was different (node didn't exist anymore). I'm not sure why /brokers/topics/foo/partitions/0/state node d

Re: Kafka topic deletion still not working well

2016-03-11 Thread Stevo Slavić
Sorry, I do not know if this is related to KAFKA-2937, I let you judge and decide whether ticket needs to be reopened or new one created. I'm still missing full picture what was happening but here are more pieces. 1) Topic foo was created (likely with Kafka 0.8.2.x). Topic foo was never used (no

Re: Kafka topic deletion still not working well

2016-03-11 Thread Mayuresh Gharat
Hi Stevo, Let me know if we want to open Kafka-2937 again. I can include the above finding in to the patch or you want to create a separate JIra for this. Thanks, Mayuresh On Fri, Mar 11, 2016 at 7:53 AM, Mayuresh Gharat wrote: > kafka-2937 is different from this I think. Kafka-2937 deals wit

Re: Kafka topic deletion still not working well

2016-03-11 Thread Mayuresh Gharat
kafka-2937 is different from this I think. Kafka-2937 deals with the delete topic getting stuck because the LeaderAndISR in ZK was updated by a controller and then the controller dies and the new controller gets in to the exception and never completes deleting the topic. The topic existed in the cl

Re: Kafka topic deletion still not working well

2016-03-11 Thread Stevo Slavić
Topic it seems would get deleted but request in ZK to delete topic would not get cleared even after restarting Kafka cluster. I'm still investigating why deletion did not complete in the first place without restarting any nodes. It seems something smelly happens when there is request to delete mor

Re: Kafka topic deletion still not working well

2016-03-05 Thread Guozhang Wang
Thanks Stevo, Feel free to paste your findings in KAFKA-2937, we can re-open that ticket if necessary. Guozhang On Fri, Mar 4, 2016 at 4:38 AM, Stevo Slavić wrote: > Hell Apache Kafka community, > > I'm still investigating an incident; from initial findings topic deletion > doesn't seem to wor

Kafka topic deletion still not working well

2016-03-04 Thread Stevo Slavić
Hell Apache Kafka community, I'm still investigating an incident; from initial findings topic deletion doesn't seem to work well still with Kafka 0.9.0.1, likely some edge case not covered. Before with 0.8.2.x it used to happen that non-lead replica would be stuck in topic deletion process, and w