Re: Deleting/Purging data from Kafka topics (Kafka 0.10)

2017-06-23 Thread karan alang
> Thanks. > --Vahid > > > > > From: karan alang > To: users@kafka.apache.org > Date: 06/22/2017 11:14 PM > Subject:Re: Deleting/Purging data from Kafka topics (Kafka 0.10) > > > > Hi Vahid, > here is the output of the GetOffsetShell com

Re: Deleting/Purging data from Kafka topics (Kafka 0.10)

2017-06-23 Thread Vahid S Hashemian
--time -2`. I hope this answers your question. Thanks. --Vahid From: karan alang To: users@kafka.apache.org Date: 06/22/2017 11:14 PM Subject: Re: Deleting/Purging data from Kafka topics (Kafka 0.10) Hi Vahid, here is the output of the GetOffsetShell commands (with --ti

Re: Deleting/Purging data from Kafka topics (Kafka 0.10)

2017-06-22 Thread karan alang
-1` you should get test:0:105 > - with `--time -2` you should get test:0:105 > > Could you please advise whether you're seeing a different behavior? > > Thanks. > --Vahid > > > > > From: "Vahid S Hashemian" > To: users@kafka.apache.org > Da

Re: Deleting/Purging data from Kafka topics (Kafka 0.10)

2017-06-22 Thread Vahid S Hashemian
ld you please advise whether you're seeing a different behavior? Thanks. --Vahid From: "Vahid S Hashemian" To: users@kafka.apache.org Date: 06/22/2017 06:43 PM Subject: Re: Deleting/Purging data from Kafka topics (Kafka 0.10) Hi Karan, I think the issue is in verif

Re: Deleting/Purging data from Kafka topics (Kafka 0.10)

2017-06-22 Thread Vahid S Hashemian
@kafka.apache.org Date: 06/22/2017 06:09 PM Subject:Re: Deleting/Purging data from Kafka topics (Kafka 0.10) Hi Vahid, somehow, the changes suggested don't seem to be taking effect, and i dont see the data being purged from the topic. Here are the steps i followed - 1) topic is set with

Re: Deleting/Purging data from Kafka topics (Kafka 0.10)

2017-06-22 Thread karan alang
Hi Vahid, somehow, the changes suggested don't seem to be taking effect, and i dont see the data being purged from the topic. Here are the steps i followed - 1) topic is set with param -- retention.ms=1000 $KAFKA10_HOME/bin/kafka-topics.sh --describe --topic topicPurge --zookeeper localhost:216

Re: Deleting/Purging data from Kafka topics (Kafka 0.10)

2017-06-22 Thread Vahid S Hashemian
Hi Karan, The other broker config that plays a role here is "log.retention.check.interval.ms". For a low log retention time like in your example if this broker config value is much higher, then the broker doesn't delete old logs regular enough. --Vahid From: karan alang To: users@kaf