Timestamps for the committed offsets in Kafka through the admin API

2022-01-23 Thread Mazen Ezzeddine
In kafka, the committed offsets for a certain consumer group can be requested through the admin client API using a code similar to the below: Map offsets = admin.listConsumerGroupOffsets(CONSUMER_GROUP) .partitionsToOffsetAndMetadata().get(); Suppose that that log.messag

Re: Kafka Log4j2.x upgrade plan

2022-01-23 Thread Edward Capriolo
All as someone who has been patching all december. There are two aspects to log4j, the log4j API and the log4j jar version. It is possible to use log4j 2.17.1 {core,api} without modifying Kafka.. Kafka itself is internally using the log4j api, but the api is implemented by the patched log4j jars.

Discuss: outage impact of not updating kafka clients to a version that has KAFKA-9893

2022-01-23 Thread Edward Capriolo
Hello, The bulk of this thread is to discuss [KAFKA-9893] Configurable TCP connection timeout and improve the initial metadata fetch - ASF JIRA (apache.org) . IMHO t it should be considered a BUG FIX and be potentially backported, but others may dis