Hi Sigalit

Did you add the classpath to the META-INF.services  folder of the reporter?

[cid:image001.png@01DAE256.1C0ADDF0]

The content of my file is:

org.apache.flink.metrics.custom.NestedGaugePrometheusReporterFactory

Kind regards

Dominik

From: Sigalit Eliazov <e.siga...@gmail.com>
Date: Monday, 29 July 2024 at 22:14
To: user <user@flink.apache.org>
Subject: custom metric reporter
Be aware: This is an external email.

hi
we have upgraded from flink 1.16 to 1.18 and our custom metric stopped working.
i saw in the release note of 1.17 that there was a change so i have defined the 
following

metrics.reporters: otlp
metrics.reporter.otlp.factory.class: 
xxx.flink.metrics.otlp.OpenTelemetryProtocolReporterFactory
metrics.reporter.otlp.interval: 30s
metrics.reporter.otlp.filter: XXXX
metrics.reporter.otlp.prefix: pipeline_

i have defined OpenTelemetryProtocolReporterFactory that implements 
MetricReporterFactory

i verified the jar with my reporter and factory exists under flink/plugins

and still i get the following warning during deployment which indicates that my 
reporter is not loaded

2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: external-resource-gpu
2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: metrics-datadog
2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: metrics-graphite
2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: metrics-influx
2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: metrics-jmx
2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: metrics-prometheus
2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: metrics-slf4j
2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: metrics-statsd
2024-07-29 19:52:37,836 INFO  org.apache.flink.core.plugin.DefaultPluginManager 
           [] - Plugin loader with ID found, reusing it: metrics-otlp

2024-07-29 14:27:31,727 WARN  org.apache.flink.runtime.metrics.ReporterSetup    
           [] - The reporter factory 
(xxx.flink.infra.metric.OpenTelemetryProtocolReporterFactory) could not be 
found for reporter otlp.

Available factories: 
[org.apache.flink.metrics.datadog.DatadogHttpReporterFactory, 
org.apache.flink.metrics.slf4j.Slf4jReporterFactory, 
org.apache.flink.metrics.graphite.GraphiteReporterFactory,

org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporterFactory, 
org.apache.flink.metrics.statsd.StatsDReporterFactory, 
org.apache.flink.metrics.prometheus.PrometheusReporterFactory,

org.apache.flink.metrics.jmx.JMXReporterFactory, 
org.apache.flink.metrics.influxdb.InfluxdbReporterFactory].

2024-07-29 14:27:31,732 INFO  
org.apache.flink.runtime.metrics.MetricRegistryImpl          [] - No metrics 
reporter configured, no metrics will be exposed/reported.

I am not sure why the new reporter is not loaded. i did not see any exception

Is there any additional configuration required?



Thanks

Sigalit






Reply via email to