How long do you have your retention configuration set for under server.properties? Is it under 30 hours?
On Thu, Jul 16, 2015 at 10:44 PM, Ashish Singh <asi...@cloudera.com> wrote: > Hi Marina, > > Is this reproducible? Can you reproduce this with a smaller number of > events? Did you see any error in broker /server logs? > > On Thu, Jul 16, 2015 at 5:42 PM, Marina <ppi...@yahoo.com.invalid> wrote: > > > A variation on the posted question - as a new thread so that not to > > high-jack the original one... > > How long does it usually take to finally delete the topic? I tried to > > delete the topic via > > /bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic mytopic > > and saw that it was "marked for deletion". However, about 30 hours > later, > > the topic is still showing up in the list of topics: > > => bin/kafka-topics.sh --list --zookeeper localhost:2181 > > __consumer_offsets > > mytopic > > > > The topic did have about 150 million events as Log size, but none were > > unprocessed (Lag == 0). > > As a test , I tried to create a new topic , and delete it right away with > > no events posted - and in that case it was deleted for good right away. > > I'm using kafka 1.8.2.1 > > thanks!MArina > > > > From: Stevo Slavić <ssla...@gmail.com> > > To: users@kafka.apache.org > > Sent: Thursday, July 16, 2015 6:56 PM > > Subject: Re: Delete topic using Admintools is not working > > > > Hello Sivananda, > > > > Calling AdminUtils.deleteTopic just requests topic to be deleted - it > does > > not actually delete topic immediately. Requests for topic deletion get > > saved in ZooKeeper as a node (named by topic name), under > > /admin/delete_topics node. > > > > If brokers in the cluster are configured with topic deletion enabled, and > > if they are running, they will notice requests to delete the topic, > perform > > actual deletion (all partitions on all brokers, lead and replicas, as > well > > as deletion of topic metadata in zookeeper), and also delete saved > request > > for topic deletion (that node under /admin/delete_topics). This broker > side > > part of topic deletion process is only working in Kafka 0.8.2.x. > > > > From your stack trace it seems you've requested topic deletion at least > > twice, while topic has not been deleted yet, so zk client used by admin > > utils, throws exception signalling that the node (request for topic > > deletion) already exists. > > > > If topic is not getting deleted even after a while I'd suggest that you > > check version, configuration and running status of your Kafka cluster. > > > > Kind regards, > > Stevo Slavic. > > > > > > > > On Fri, Jul 17, 2015 at 12:40 AM, Sivananda Reddy < > sivananda2...@gmail.com > > > > > wrote: > > > > > Hi, > > > > > > As per the jira https://issues.apache.org/jira/browse/KAFKA-1737, I > have > > > set ZKStringSerializer, while creating the ZkClient and still the > delete > > > topic function call is not working: > > > > > > Version: kafka_2.11-0.8.2.1 > > > > > > *My code looks like this*: > > > ZkClient zkClient = new ZkClient("localhost:2181", 6000, 6000, > > > ZKStringSerializer$.MODULE$); > > > AdminUtils.deleteTopic(zkClient, "testTopic17"); > > > > > > *I am getting the following exception's*: > > > Exception in thread "main" > > > org.I0Itec.zkclient.exception.ZkNodeExistsException: > > > org.apache.zookeeper.KeeperException$NodeExistsException: > > KeeperErrorCode = > > > NodeExists for /admin/delete_topics/testTopic17 > > > at > > > org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:55) > > > at > org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685) > > > at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304) > > > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:243) > > > at kafka.utils.ZkUtils$.createPersistentPath(ZkUtils.scala:306) > > > at kafka.admin.AdminUtils$.deleteTopic(AdminUtils.scala:159) > > > at kafka.admin.AdminUtils.deleteTopic(AdminUtils.scala) > > > at Test.deleteTopic(Test.java:98) > > > at Test.main(Test.java:76) > > > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: > > > KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17 > > > at > > > org.apache.zookeeper.KeeperException.create(KeeperException.java:119) > > > at > > org.apache.zookeeper.KeeperException.create(KeeperException.java:51) > > > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) > > > at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87) > > > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308) > > > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304) > > > at > org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675) > > > ... 7 more > > > > > > *The corresponding zookeeper logs*: > > > [2015-07-16 15:31:14,383] INFO Accepted socket connection from / > > > 127.0.0.1:23363 (org.apache.zookeeper.server.NIOServerCnxnFactory) > > > [2015-07-16 15:31:14,385] INFO Client attempting to establish new > session > > > at /127.0.0.1:23363 (org.apache.zookeeper.server.ZooKeeperServer) > > > [2015-07-16 15:31:14,391] INFO Established session 0x14e98d2ce98000c > with > > > negotiated timeout 6000 for client /127.0.0.1:23363 > > > (org.apache.zookeeper.server.ZooKeeperServer) > > > [2015-07-16 15:31:14,510] INFO Got user-level KeeperException when > > > processing sessionid:0x14e98d2ce98000c type:create cxid:0x1 zxid:0x963 > > > txntype:-1 reqpath:n/a Error Path:/admin/delete_topics/testTopic17 > > > Error:KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17 > > > (org.apache.zookeeper.server.PrepRequestProcessor) > > > [2015-07-16 15:31:14,842] WARN caught end of stream exception > > > (org.apache.zookeeper.server.NIOServerCnxn) > > > EndOfStreamException: Unable to read additional data from client > > sessionid > > > 0x14e98d2ce98000c, likely client has closed socket > > > at > > > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) > > > at > > > > > > > > > org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) > > > at java.lang.Thread.run(Thread.java:744) > > > [2015-07-16 15:31:14,843] INFO Closed socket connection for client / > > > 127.0.0.1:23363 which had sessionid 0x14e98d2ce98000c > > > (org.apache.zookeeper.server.NIOServerCnxn) > > > [2015-07-16 15:31:21,000] INFO Expiring session 0x14e98d2ce98000c, > > timeout > > > of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer) > > > [2015-07-16 15:31:21,001] INFO Processed session termination for > > sessionid: > > > 0x14e98d2ce98000c (org.apache.zookeeper.server.PrepRequestProcessor) > > > > > > Could someone please let me know if I am missing anything? > > > > > > Thank you, > > > Siva. > > > > > > > > > > > > > > -- > > Regards, > Ashish > -- Jiefu Gong University of California, Berkeley | Class of 2017 B.A Computer Science | College of Letters and Sciences jg...@berkeley.edu <elise...@berkeley.edu> | (925) 400-3427
