Hey everyone, I am a little bit confused about how the kafka-consumer-groups.sh/ ConsumerGroupCommand works, and was hoping someone could shed some light on this for me.
We are running Kafka 0.10.1.0, and using the new Consumer API with the Confluent.Kafka C# library (v0.9.5) that uses librdkafka. Today, I was trying to get some details on what consumers were running, and their position within a couple of topics, but when I ran the following, I did not see the group in the list. ./bin/kafka-consumer-groups.sh --bootstrap-server [our servers] --new-consumer --list I see a few groups listed, but none of the ones I was expecting to see. I saw this in the documentation: *"When using the new consumer API <http://kafka.apache.org/documentation.html#newconsumerapi> (where the broker handles coordination of partition handling and rebalance), the group is deleted when the last committed offset for that group expires"* Is that related to log retention time? If so, is it saying that the group will be deleted from the list once the highest committed offset of its group is past its configured log retention time? The issue I am facing is that we have a consumer group that is actively consuming. At one point, I am sure the messages in the topic it is consuming expired, but since then, more messages have been added, and it has been consuming & committing higher offsets. Shouldn't that group have come back on the list? Any ideas would be very helpful. Thanks, Subhash