hi
we have upgraded from flink 1.16 to 1.18 and our custom metric stopped
working.
i saw in the release note of 1.17 that there was a change so i have defined
the following

metrics.reporters: otlp
metrics.reporter.otlp.factory.class:
xxx.flink.metrics.otlp.OpenTelemetryProtocolReporterFactory
metrics.reporter.otlp.interval: 30s
metrics.reporter.otlp.filter: XXXX
metrics.reporter.otlp.prefix: pipeline_

i have defined OpenTelemetryProtocolReporterFactory that implements
MetricReporterFactory

i verified the jar with my reporter and factory exists under flink/plugins

and still i get the following warning during deployment which
indicates that my reporter is not loaded

2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: external-resource-gpu
2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: metrics-datadog
2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: metrics-graphite
2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: metrics-influx
2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: metrics-jmx
2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: metrics-prometheus
2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: metrics-slf4j
2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: metrics-statsd
2024-07-29 19:52:37,836 INFO
org.apache.flink.core.plugin.DefaultPluginManager            [] -
Plugin loader with ID found, reusing it: *metrics-otlp*

2024-07-29 14:27:31,727 WARN
org.apache.flink.runtime.metrics.ReporterSetup               [] - The
reporter factory
(xxx.flink.infra.metric.OpenTelemetryProtocolReporterFactory) could
not be found for reporter otlp.

Available factories:
[org.apache.flink.metrics.datadog.DatadogHttpReporterFactory,
org.apache.flink.metrics.slf4j.Slf4jReporterFactory,
org.apache.flink.metrics.graphite.GraphiteReporterFactory,

org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporterFactory,
org.apache.flink.metrics.statsd.StatsDReporterFactory,
org.apache.flink.metrics.prometheus.PrometheusReporterFactory,

org.apache.flink.metrics.jmx.JMXReporterFactory,
org.apache.flink.metrics.influxdb.InfluxdbReporterFactory].

2024-07-29 14:27:31,732 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl          [] - No
metrics reporter configured, no metrics will be exposed/reported.

I am not sure why the new reporter is not loaded. i did not see any exception

Is there any additional configuration required?


Thanks

Sigalit

Reply via email to