How long do you have your retention configuration set for under
server.properties? Is it under 30 hours?

On Thu, Jul 16, 2015 at 10:44 PM, Ashish Singh <asi...@cloudera.com> wrote:

> Hi Marina,
>
> Is this reproducible? Can you reproduce this with a smaller number of
> events? Did you see any error in broker /server logs?
>
> On Thu, Jul 16, 2015 at 5:42 PM, Marina <ppi...@yahoo.com.invalid> wrote:
>
> > A variation on the posted question - as a new thread so that not to
> > high-jack the original one...
> > How long does it usually take to finally delete the topic? I tried to
> > delete the topic via
> > /bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic mytopic
> > and saw that it was "marked for deletion". However,  about 30 hours
> later,
> > the topic is still showing up in the list of topics:
> > => bin/kafka-topics.sh --list --zookeeper localhost:2181
> > __consumer_offsets
> > mytopic
> >
> > The topic did have about 150 million events as Log size, but none were
> > unprocessed (Lag == 0).
> > As a test , I tried to create a new topic , and delete it right away with
> > no events posted - and in that case it was deleted for good right away.
> > I'm using kafka 1.8.2.1
> > thanks!MArina
> >
> >       From: Stevo Slavić <ssla...@gmail.com>
> >  To: users@kafka.apache.org
> >  Sent: Thursday, July 16, 2015 6:56 PM
> >  Subject: Re: Delete topic using Admintools is not working
> >
> > Hello Sivananda,
> >
> > Calling AdminUtils.deleteTopic just requests topic to be deleted - it
> does
> > not actually delete topic immediately. Requests for topic deletion get
> > saved in ZooKeeper as a node (named by topic name), under
> > /admin/delete_topics node.
> >
> > If brokers in the cluster are configured with topic deletion enabled, and
> > if they are running, they will notice requests to delete the topic,
> perform
> > actual deletion (all partitions on all brokers, lead and replicas, as
> well
> > as deletion of topic metadata in zookeeper), and also delete saved
> request
> > for topic deletion (that node under /admin/delete_topics). This broker
> side
> > part of topic deletion process is only working in Kafka 0.8.2.x.
> >
> > From your stack trace it seems you've requested topic deletion at least
> > twice, while topic has not been deleted yet, so zk client used by admin
> > utils, throws exception signalling that the node (request for topic
> > deletion) already exists.
> >
> > If topic is not getting deleted even after a while I'd suggest that you
> > check version, configuration and running status of your Kafka cluster.
> >
> > Kind regards,
> > Stevo Slavic.
> >
> >
> >
> > On Fri, Jul 17, 2015 at 12:40 AM, Sivananda Reddy <
> sivananda2...@gmail.com
> > >
> > wrote:
> >
> > > Hi,
> > >
> > > As per the jira https://issues.apache.org/jira/browse/KAFKA-1737, I
> have
> > > set ZKStringSerializer, while creating the ZkClient and still the
> delete
> > > topic function call is not working:
> > >
> > > Version: kafka_2.11-0.8.2.1
> > >
> > > *My code looks like this*:
> > > ZkClient zkClient = new ZkClient("localhost:2181", 6000, 6000,
> > > ZKStringSerializer$.MODULE$);
> > > AdminUtils.deleteTopic(zkClient, "testTopic17");
> > >
> > > *I am getting the following exception's*:
> > > Exception in thread "main"
> > > org.I0Itec.zkclient.exception.ZkNodeExistsException:
> > > org.apache.zookeeper.KeeperException$NodeExistsException:
> > KeeperErrorCode =
> > > NodeExists for /admin/delete_topics/testTopic17
> > >    at
> > > org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:55)
> > >    at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
> > >    at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
> > >    at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:243)
> > >    at kafka.utils.ZkUtils$.createPersistentPath(ZkUtils.scala:306)
> > >    at kafka.admin.AdminUtils$.deleteTopic(AdminUtils.scala:159)
> > >    at kafka.admin.AdminUtils.deleteTopic(AdminUtils.scala)
> > >    at Test.deleteTopic(Test.java:98)
> > >    at Test.main(Test.java:76)
> > > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException:
> > > KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > >    at
> > > org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> > >    at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> > >    at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> > >    at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
> > >    at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
> > >    at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
> > >    at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
> > >    ... 7 more
> > >
> > > *The corresponding zookeeper logs*:
> > > [2015-07-16 15:31:14,383] INFO Accepted socket connection from /
> > > 127.0.0.1:23363 (org.apache.zookeeper.server.NIOServerCnxnFactory)
> > > [2015-07-16 15:31:14,385] INFO Client attempting to establish new
> session
> > > at /127.0.0.1:23363 (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:14,391] INFO Established session 0x14e98d2ce98000c
> with
> > > negotiated timeout 6000 for client /127.0.0.1:23363
> > > (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:14,510] INFO Got user-level KeeperException when
> > > processing sessionid:0x14e98d2ce98000c type:create cxid:0x1 zxid:0x963
> > > txntype:-1 reqpath:n/a Error Path:/admin/delete_topics/testTopic17
> > > Error:KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > > (org.apache.zookeeper.server.PrepRequestProcessor)
> > > [2015-07-16 15:31:14,842] WARN caught end of stream exception
> > > (org.apache.zookeeper.server.NIOServerCnxn)
> > > EndOfStreamException: Unable to read additional data from client
> > sessionid
> > > 0x14e98d2ce98000c, likely client has closed socket
> > >    at
> > > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> > >    at
> > >
> > >
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> > >    at java.lang.Thread.run(Thread.java:744)
> > > [2015-07-16 15:31:14,843] INFO Closed socket connection for client /
> > > 127.0.0.1:23363 which had sessionid 0x14e98d2ce98000c
> > > (org.apache.zookeeper.server.NIOServerCnxn)
> > > [2015-07-16 15:31:21,000] INFO Expiring session 0x14e98d2ce98000c,
> > timeout
> > > of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:21,001] INFO Processed session termination for
> > sessionid:
> > > 0x14e98d2ce98000c (org.apache.zookeeper.server.PrepRequestProcessor)
> > >
> > > Could someone please let me know if I am missing anything?
> > >
> > > Thank you,
> > > Siva.
> > >
> >
> >
> >
>
>
>
>
> --
>
> Regards,
> Ashish
>



-- 

Jiefu Gong
University of California, Berkeley | Class of 2017
B.A Computer Science | College of Letters and Sciences

jg...@berkeley.edu <elise...@berkeley.edu> | (925) 400-3427

Reply via email to