Re: Topic deletion issues

Hi, I've run into similar issues in the past (in 0.8.2), in a script that re-creates a topic setup for testing (delete + create). I added a one second sleep between delete and create, it solved the sporadic topic creation failure for me. I hope that helps, Ofir On Thu, Dec 31, 2015 at 5:39 AM,

kafka-run-class can not launch ConsumerGroupCommand in 0.9

Hi, I'm trying to check the offset of a consumer group with the new consumer API. But it seems that kafka-run-class cannot launch `ConsumerGroupCommand`. bin/kafka-run-class.sh kafka.tools.ConsumerGroupCommand --zookeeper localhost:2181 --group my-group >> Error: Could not find or load main class

jruby-kafka v2.0 and v1.5 released!

Hi Everyone, It's been a little while but I have two releases today. First v1.5 and v2.0 both add support for Kafka v0.8.2.2. Next v2.0 has been greatly enhanced to allow better consumer parallelism. Both releases have been pushed to https://rubygems.org/gems/jruby-kafka Please report any issues

Re: Consumer group disappears and consumers loops

I've run into exactly the same problem, and a similar workaround, along with a config change, seems to be working for now, but I can probably add a little detail. Scenario: The code reads from a very high-volume topic on a remote server (with 120 partitions and no SSL or security). I am currently

Re: How to reset a consumer-group's offset in kafka 0.9?

Hello Han, 1. As Marko mentioned you can use "seek" in the 0.9 Java consumer to reset your consuming offsets. Or if you are stopping the consumer between your test runs you can also commit() with offset 0 before you closing your consumer at the end of each test. 2. In the 0.9 Java consumer both t

Re: __consumer_offsets Topic files are not getting deleted after log retention hrs

There is a special config for that topic named "offsets.retention.minutes" besides the "log.retention.hours", and similarly a different "offsets.topic.segment.bytes" for that topic as well. Could you check what are the values? Note that only old log segments will be considered for deletion so if y

Re: consuming 0 records

Franco, I think this is a mis-documentation of "poll(0)": https://issues.apache.org/jira/browse/KAFKA-3044 As for your case, I would suggest trying with poll(x) where x is reasonably large, it does not mean "always wait for that among of time", but "wait for at most approximately that among of ti

Re: kafka-run-class can not launch ConsumerGroupCommand in 0.9

Han, It's kafka.admin.ConsumerGroupCommand, you can also use bin/kafka-consumer-groups.sh Guozhang On Thu, Dec 31, 2015 at 6:23 AM, Han JU wrote: > Hi, > > I'm trying to check the offset of a consumer group with the new consumer > API. But it seems that kafka-run-class cannot launch > `Consume

Re: __consumer_offsets Topic files are not getting deleted after log retention hrs

Make sure that you have *log.cleaner.enable* set to *true* (it is false by default). Check this KAFKA-2988 out for details. On Thu, Dec 31, 2015 at 11:13 AM, Guozhang Wang wrote: > There is a special config for that topic named "offsets.retenti