Delete was actually considered to be working since Kafka 0.8.2 (although there are still not easily reproducible edge cases when it doesn't work well even in in 0.8.2 or newer). In 0.8.1 one could request topic to be deleted (request gets stored as entry in ZooKeeper), because of presence of the request for topic to be deleted topic would become unusable (cannot publish or read), but broker would actually never (work on the request to) delete topic.
Maybe it will be enough to delete from ZooKeeper entry for the topic deletion request under /admin/delete_topics to have topic usable again. Otherwise, just upgrade broker side to 0.8.2.x or latest 0.9.0.0 - new broker should work with old clients so maybe you don't have to upgrade client side immediately. Kind regards, Stevo Slavic. On Fri, Dec 4, 2015 at 12:33 AM, Mayuresh Gharat <gharatmayures...@gmail.com > wrote: > Can you paste some logs from the controller, when you deleted the topic? > > Thanks, > > Mayuresh > > On Thu, Dec 3, 2015 at 2:30 PM, Rakesh Vidyadharan < > rvidyadha...@gracenote.com> wrote: > > > Hello, > > > > We are on an older kafka (0.8.1) version. While a number of consumers > > were running, we attempted to delete a few topics using the > kafka-topics.sh > > file (basically want to remove all messages in that topic and restart, > > since our entities went through some incompatible changes). We noticed > > logs saying the topic has been queued for deletion. After stopping all > > processes accessing kafka, we restarted kafka and then our processes. > The > > old topics do not seem to have been deleted (I can still see the log > > directories corresponding to the topics), and none of the clients are > able > > to either publish or read to the topics that we attempted to delete. > > Attempting to read gives us the following type of error: > > > > Attempting to access an invalid KafkaTopic ( are you operating on a > closed > > KafkaTopic ?) > > > > Attempting to publish gives us a more general type of error: > > > > kafka.common.FailedToSendMessageException: Failed to send messages after > 3 > > tries. > > at > > > kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:90) > > at kafka.producer.Producer.send(Producer.scala:76) > > > > How can be get around this issue and start using the topics that we tried > > to clean up? There may have been better ways to achieve what we wanted, > if > > so please suggest recommendations as well. > > > > Thanks > > Rakesh > > > > > > > -- > -Regards, > Mayuresh R. Gharat > (862) 250-7125 >
