[
https://issues.apache.org/jira/browse/FLINK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511578#comment-17511578
]
Adrian Zhong edited comment on FLINK-22766 at 3/24/22, 4:04 AM:
----------------------------------------------------------------
I'd like to say: KafkaPartitionSplitReader is using KafkaClient API which was
introduced since 2.4.1.
[KIP-520: Add overloaded Consumer#committed for batching
partitions|https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=128651203]
{code:java}
org.apache.kafka.clients.consumer.KafkaConsumer#committed(java.util.Set<org.apache.kafka.common.TopicPartition>)
{code}
if you are using flink-kafka-connector-1.12.3 or above，Kafka-clients version
2.4.1 or above is required, otherwise, an exception is thrown.
{code:java}
Caused by: java.lang.NoSuchMethodError:
org.apache.kafka.clients.consumer.KafkaConsumer.committed(Ljava/util/Set;)Ljava/util/Map;
at
org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader.acquireAndSetStoppingOffsets(KafkaPartitionSplitReader.java:331)
~[flink-application-xxxx.jar:?]
{code}
was (Author: adrian z):
I'd like to say: KafkaPartitionSplitReader is using KafkaClient API which was
introduced since 2.4.1.
{code:java}
org.apache.kafka.clients.consumer.KafkaConsumer#committed(java.util.Set<org.apache.kafka.common.TopicPartition>)
{code}
if you are using flink-kafka-connector-1.12.3 or above，Kafka-clients version
2.4.1 or above is required, otherwise, an exception is thrown.
{code:java}
Caused by: java.lang.NoSuchMethodError:
org.apache.kafka.clients.consumer.KafkaConsumer.committed(Ljava/util/Set;)Ljava/util/Map;
at
org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader.acquireAndSetStoppingOffsets(KafkaPartitionSplitReader.java:331)
~[flink-application-xxxx.jar:?]
{code}
> Report metrics of KafkaConsumer in Kafka new source
> ---------------------------------------------------
>
> Key: FLINK-22766
> URL: https://issues.apache.org/jira/browse/FLINK-22766
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Kafka
> Affects Versions: 1.13.0
> Reporter: Qingsheng Ren
> Assignee: Qingsheng Ren
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.14.0, 1.13.2
>
>
> Currently Kafka new source doesn't register metrics of KafkaConsumer in
> KafkaPartitionSplitReader. These metrics should be added for debugging and
> monitoring purpose.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
