Ann,
You can try execute the CLI `kafka-consumer-groups` with TRACE enabled
to dig a little deeper in the problem. In order to do this you need to:
1. Make a copy of your `$KAFKA_HOME/etc/kafka/tools-log4j.properties` file
2. Set `root.logger=TRACE,console`
3. Run `export
KAFKA_OPTS="-Dlog4j.configuration=file:/tmp/tools-log4j.properties"`
before executing the `kafka-consumer-groups` CLI.
Thanks,
-- Ricardo
On 7/8/20 6:56 AM, Ann Pricks wrote:
Hi Team,
Any update on this.
Regards,
Pricks
From: Ann Pricks <pri...@dt.ae>
Date: Friday, 3 July 2020 at 4:10 PM
To: "users@kafka.apache.org" <users@kafka.apache.org>
Subject: Consumer Groups Describe is not working
Hi Team,
Today, In our production cluster, we faced an issue with Kafka (Old offsets was
getting pulled from spark streaming application) and couldn't debug the issue
using kafka_consumer_group.sh CLI.
Whenever we execute the below command to list the consumer groups, it is
working fine. However, whenever we try to describe the consumer group to get to
know the offset details, it didn't work (Nothing is getting displayed. Just
blank).
Command to list the consumer group (Working):
/opt/kafka/kafka_2.11-2.0.0/bin/kafka-consumer-groups.sh \
--bootstrap-server broker1:2345,broker2:2345,broker3:2345 \
--list \
--command-config /opt/kafka/kafka_2.11-2.0.0/config/jaas_config.conf
Command to list the consumer group (Not Working):
/opt/kafka/kafka_2.11-2.0.0/bin/kafka-consumer-groups.sh \
--bootstrap-server broker1:2345,broker2:2345,broker3:2345 \
--describe \
--group
spark-kafka-source-f8e218d5-16d2-4e63-a25c-2f96fabb2809-605351645-driver-0 \
--command-config /opt/kafka/kafka_2.11-2.0.0/config/jaas_config.conf
Jass Config File:
sasl.jaas.config=org.apache.kafka.common.security.scram.ScramLoginModule
required \
username="admin" \
password="123@admin";
security.protocol=SASL_PLAINTEXT
sasl.mechanism=SCRAM-SHA-512
exclude.internal.topics=false
Kindly help us to monitor our Kafka cluster in case of any issues.
Details:
Kafka Version: 2.0.0
Security:
sasl.enabled.mechanisms=SCRAM-SHA-512
sasl.mechanism.inter.broker.protocol=SCRAM-SHA-512
security.inter.broker.protocol=SASL_PLAINTEXT
Please let us know in case of any other details required from our end.
Regards,
AnnPricksEdmund
