There is an open bug for this here: https://issues.apache.org/jira/browse/FLINK-24497 For log4j2 these settings worked for me:
# mute obnoxious warnings due to this bug: https://issues.apache.org/jira/browse/FLINK-24497 logger.flink_annoying_mute.name = org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics logger.flink_annoying_mute.level = error On Fri, Oct 15, 2021 at 8:08 AM Denis Nutiu <denis.nu...@gmail.com> wrote: > Hi, > > My Flink (1.14.0) job seems to output a lot of error messages with the > following text: > > 16:46:38,562 WARN > org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics [] > - Error when getting Kafka consumer metric "records-lag" for partition > "lambada.events-0". Metric "pendingBytes" may not be reported correctly. > java.lang.IllegalStateException: Cannot find Kafka metric matching current > filter. > at > org.apache.flink.connector.kafka.MetricUtil.lambda$getKafkaMetric$1(MetricUtil.java:63) > ~[flink-connector-kafka_2.11-1.14.0.jar:1.14.0] > at java.util.Optional.orElseThrow(Optional.java:408) ~[?:?] > at > org.apache.flink.connector.kafka.MetricUtil.getKafkaMetric(MetricUtil.java:61) > ~[flink-connector-kafka_2.11-1.14.0.jar:1.14.0] > at > org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics.getRecordsLagMetric(KafkaSourceReaderMetrics.java:304) > ~[flink-connector-kafka_2.11-1.14.0.jar:1.14.0] > at > org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics.lambda$maybeAddRecordsLagMetric$4(KafkaSourceReaderMetrics.java:229) > ~[flink-connector-kafka_2.11-1.14.0.jar:1.14.0] > at > java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1705) > [?:?] > at > org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics.maybeAddRecordsLagMetric(KafkaSourceReaderMetrics.java:228) > [flink-connector-kafka_2.11-1.14.0.jar:1.14.0] > at > org.apache.flink.connector.kafka.source.reader.KafkaPartitionSplitReader.fetch(KafkaPartitionSplitReader.java:187) > [flink-connector-kafka_2.11-1.14.0.jar:1.14.0] > at > org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58) > [flink-connector-base-1.14.0.jar:1.14.0] > at > org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:142) > [flink-connector-base-1.14.0.jar:1.14.0] > at > org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.run(SplitFetcher.java:105) > [flink-connector-base-1.14.0.jar:1.14.0] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) > [?:?] > at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > [?:?] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > [?:?] > at java.lang.Thread.run(Thread.java:829) [?:?] > > I tried to disable the logs by adding the following line log4j2.properties > but it did not work. > > > log4j.logger.org.apache.flink.connector.kafka.source.metrics.KafkaSourceReaderMetrics=OFF > > Is there any other way to disable the messages? > -- > Best, > Denis >
