If you have any way of capturing logs at trace level from the point of the failed attempt until 10 minutes after, it will be super useful.
We know there are issues in deleting topics, but it doesn't reproduce well, we don't know if its one issue or several and we don't have a good starting point on fixing them. So more info will help us move along. Gwen On Tue, Jan 5, 2016 at 11:03 AM, Brenden Cobb <brendenc...@gmail.com> wrote: > Hi Gwen- No, unfortunately it doesn't appear to be consistent. One day > I had no problem with rapid deletion/recreation, the next I did. > > Kafka is still obsessing about the last failed deletion attempt and > won't move on to subsequent delete requests. > > I've planned downtime today so I can restart Kafka (clearing the topic > info) and test again. > > On Tue, Jan 5, 2016 at 1:30 PM, Gwen Shapira <g...@confluent.io> wrote: > > Does the issue reproduce consistently? > > > > On Tue, Jan 5, 2016 at 10:28 AM, Brenden Cobb <brendenc...@gmail.com> > wrote: > > > >> Thanks Alex (and sorry all for the spam) > >> > >> I'll give it another go as suggested, however in my tests I was just > >> using the kafka-topics command and there was definitely a few seconds > >> between creation/deletion. > >> > >> -BC > >> > >> On Tue, Jan 5, 2016 at 1:24 PM, Alex Loddengaard <a...@confluent.io> > >> wrote: > >> > Hi Brenden, I sent the wrong permalink. Try this: > >> > > >> > > >> > http://mail-archives.apache.org/mod_mbox/kafka-users/201512.mbox/%3CCAH7vnfhUQHQcCJ1R3pS_DYn0LvmA8fJtLtvCuvvDboWSqm-NBg%40mail.gmail.com%3E > >> > > >> > Alex > >> > > >> > On Tue, Jan 5, 2016 at 10:21 AM, Alex Loddengaard <a...@confluent.io> > >> wrote: > >> > > >> >> Hi Brenden, your previous email went through, and you got a response > >> (that > >> >> I believe answers your question). See here: > >> >> > >> >> > >> > http://mail-archives.apache.org/mod_mbox/kafka-users/201512.mbox/browser > >> >> > >> >> Alex > >> >> > >> >> On Mon, Jan 4, 2016 at 7:18 PM, Brenden Cobb <brendenc...@gmail.com> > >> >> wrote: > >> >> > >> >>> I might have sent this recently, but was not able to receive mail > from > >> >>> this list (fixed) > >> >>> --- > >> >>> > >> >>> Hello- > >> >>> > >> >>> We have a use case where we're trying to create a topic, delete, > then > >> >>> recreate with the same topic name. > >> >>> > >> >>> Running into inconsistant results. > >> >>> > >> >>> Creating the topic: > >> >>> /opt/kafka/bin/kafka-topics.sh --create --partitions 3 > >> >>> --replication-factor 3 --topic test-01 --zookeeper zoo01:2181, > >> >>> zoo02:2181, zoo03:2181 > >> >>> > >> >>> Delete: > >> >>> /opt/kafka/bin/kafka-topics.sh --delete --topic test-01 --zookeeper > >> >>> zoo01:2181, zoo02:2181, zoo03:2181 > >> >>> > >> >>> Repeat creation. > >> >>> > >> >>> The results are inconsistant. Executing the above several times can > be > >> >>> successful, then sporadically we get caught in "topic marked for > >> >>> deletion" and it does not clear. > >> >>> > >> >>> This appears to be a Zookeeper issue of sorts as the logs will show: > >> >>> [2015-12-30 22:32:32,946] WARN Conditional update of path > >> >>> /brokers/topics/test-01/partitions/0/state with data > >> >>> > >> >>> > >> > {"controller_epoch":21,"leader":2,"version":1,"leader_epoch":1,"isr":[2,0,1]} > >> >>> and expected version 1 failed due to > >> >>> org.apache.zookeeper.KeeperException$NoNodeException: > KeeperErrorCode > >> >>> = NoNode for /brokers/topics/test-01/partitions/0/state > >> >>> (kafka.utils.ZkUtils$) > >> >>> > >> >>> In this instance no subdirectories exist beyond > /brokers/topics/test-01 > >> >>> > >> >>> I'd like to know if this is a common occurrance and why the > Zookeeper > >> >>> node isn't "fully" created as Kafka deletion seems stuck without the > >> >>> expected node path. > >> >>> > >> >>> We are using Kafka 8.2. Purging is also an option (if achievable > >> >>> programmatically), we just need to make sure there are no messages > >> >>> left when resuming the producer. > >> >>> > >> >>> Appreciate any info/guidance. > >> >>> > >> >>> Thanks, > >> >>> BC > >> >>> > >> >> > >> >> > >> >> > >> >> -- > >> >> *Alex Loddengaard | **Solutions Architect | Confluent* > >> >> *Download Apache Kafka and Confluent Platform: > >> www.confluent.io/download > >> >> <http://www.confluent.io/download>* > >> >> > >> > > >> > > >> > > >> > -- > >> > *Alex Loddengaard | **Solutions Architect | Confluent* > >> > *Download Apache Kafka and Confluent Platform: > www.confluent.io/download > >> > <http://www.confluent.io/download>* > >> >
