We are evaluating Kafka starting with 0.9.0.1 and among v0.9 new consumer clients, we can monitor/describe them when they are actually running but how do you get the last committed offsets of all groups once they are down or have stopped consuming?
This command only works when "new consumers are running". $KAFKA_HOME/bin/kafka-run-class.sh kafka.admin.ConsumerGroupCommand --new-consumer --bootstrap-server 10.35.25.95:32774 --list And there are consumer groups also in ZK as well, they probably are old consumers that use ZK. This command "do not obviously work" for new consumers as they "do not use ZK", but how else do we get these? $KAFKA_HOME/bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zookeeper $ZK --group DemoConsumer17 [2016-03-23 19:38:55,464] WARN WARNING: ConsumerOffsetChecker is deprecated and will be dropped in releases following 0.9.0. Use ConsumerGroupCommand instead. (kafka.tools.ConsumerOffsetChecker$) Exiting due to: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /consumers/DemoConsumer17/owners.