; > > > > I think option 2 and option 3 won't work, because there can be only
> > one
> > > > > version of the client. I don't think we should make a clean break
> on
> > > > > metrics in a minor version, but only in major. All in all, I t
Ryan van Huuksloot created FLINK-32508:
--
Summary: Flink-Metrics Prometheus - Native Histograms / Native
Counters
Key: FLINK-32508
URL: https://issues.apache.org/jira/browse/FLINK-32508
Project
> I'd have to check but the original plan is to upgrade the client but keep
> the flink-metrics-prometheus implementation the same. This should keep the
> metrics collection consistent even with the client upgrade - this would
> need to be verified.
>
> But if that is the
I'd have to check but the original plan is to upgrade the client but keep
the flink-metrics-prometheus implementation the same. This should keep the
metrics collection consistent even with the client upgrade - this would
need to be verified.
But if that is the worry then we could create
; > On Thu, Jun 29, 2023 at 5:56 PM Ryan van Huuksloot
> > wrote:
> >
> > > Hi Martijn,
> > >
> > > Our team shared the same concern. We've considered a few options:
> > >
> > >
> > > *1. Add a new package such as `flink-m
rtijn,
> >
> > Our team shared the same concern. We've considered a few options:
> >
> >
> > *1. Add a new package such as `flink-metrics-prometheus-native` and
> > eventually deprecate the original.*
> > *Pros:*
> > - Supports backward compatibil
remove it
with Flink 2.0 imho.
Best regards,
Martijn
On Thu, Jun 29, 2023 at 5:56 PM Ryan van Huuksloot
wrote:
> Hi Martijn,
>
> Our team shared the same concern. We've considered a few options:
>
>
> *1. Add a new package such as `flink-metrics-prometheus-native` and
&g
Hi Martijn,
Our team shared the same concern. We've considered a few options:
*1. Add a new package such as `flink-metrics-prometheus-native` and
eventually deprecate the original.*
*Pros:*
- Supports backward compatibility.
*Cons:*
- Two packages to maintain in the interim.
- Not consi
Hi Ryan,
I think there definitely is an interest in the
flink-metrics-prometheus, but I do see some challenges as well. Given
that the Prometheus simpleclient doesn't yet have a major version,
there are breaking changes happening in that. If we would update this,
it can/probably break
Following up, any interest in flink-metrics-prometheus? It is quite a stale
package. I would be interested in contributing - time permitting.
Ryan van Huuksloot
Sr. Production Engineer | Streaming Platform
[image: Shopify]
<https://www.shopify.com/?utm_medium=salessignatures&utm_source=h
Hello,
Internally we use the flink-metrics-prometheus jar and we noticed that the
code is a little out of date. Primarily, there are new metric types in
Prometheus that would allow for the exporter to write Counters and
Histograms as Native metrics in prometheus (vs writing as Gauges).
I noticed
钟洋洋 created FLINK-29970:
---
Summary: Prometheus cannot collect flink metrics
Key: FLINK-29970
URL: https://issues.apache.org/jira/browse/FLINK-29970
Project: Flink
Issue Type: Bug
Components
From: "Oliveira, Joao / Kuehne + Nagel / Opo MI-DH"
Date: Wednesday, 3 August 2022 at 09:54
To: "u...@flink.apache.org"
Cc: "Melo, Jose / Kuehne + Nagel / Opo MI-DH"
Subject: 1.13.2 - Flink Metrics not updated during job execution
Hi Flink team,
My name i
Gyula Fora created FLINK-27914:
--
Summary: Integrate JOSDK metrics with Flink Metrics reporter
Key: FLINK-27914
URL: https://issues.apache.org/jira/browse/FLINK-27914
Project: Flink
Issue Type
jiangchunyang created FLINK-27661:
-
Summary: [Metric]Flink-Metrics pushgateway support authentication
Key: FLINK-27661
URL: https://issues.apache.org/jira/browse/FLINK-27661
Project: Flink
hao wang created FLINK-27163:
Summary: Fix typo issue in Flink Metrics documentation
Key: FLINK-27163
URL: https://issues.apache.org/jira/browse/FLINK-27163
Project: Flink
Issue Type: Bug
Chesnay Schepler created FLINK-26230:
Summary: [JUnit5 Migration] Module: flink-metrics-core
Key: FLINK-26230
URL: https://issues.apache.org/jira/browse/FLINK-26230
Project: Flink
Issue
Chesnay Schepler created FLINK-26229:
Summary: [JUnit5 Migration] Module: flink-metrics-datadog
Key: FLINK-26229
URL: https://issues.apache.org/jira/browse/FLINK-26229
Project: Flink
Chesnay Schepler created FLINK-26228:
Summary: [JUnit5 Migration] Module: flink-metrics-dropwizard
Key: FLINK-26228
URL: https://issues.apache.org/jira/browse/FLINK-26228
Project: Flink
Chesnay Schepler created FLINK-26227:
Summary: [JUnit5 Migration] Module: flink-metrics-graphite
Key: FLINK-26227
URL: https://issues.apache.org/jira/browse/FLINK-26227
Project: Flink
Chesnay Schepler created FLINK-26226:
Summary: [JUnit5 Migration] Module: flink-metrics-influxdb
Key: FLINK-26226
URL: https://issues.apache.org/jira/browse/FLINK-26226
Project: Flink
Chesnay Schepler created FLINK-26225:
Summary: [JUnit5 Migration] Module: flink-metrics-jmx
Key: FLINK-26225
URL: https://issues.apache.org/jira/browse/FLINK-26225
Project: Flink
Issue
Chesnay Schepler created FLINK-26221:
Summary: [JUnit5 Migration] Module: flink-metrics-prometheus
Key: FLINK-26221
URL: https://issues.apache.org/jira/browse/FLINK-26221
Project: Flink
Chesnay Schepler created FLINK-26219:
Summary: [JUnit5 Migration] Module: flink-metrics-slf4j
Key: FLINK-26219
URL: https://issues.apache.org/jira/browse/FLINK-26219
Project: Flink
Issue
Chesnay Schepler created FLINK-26215:
Summary: [JUnit5 Migration] Module: flink-metrics-statsd
Key: FLINK-26215
URL: https://issues.apache.org/jira/browse/FLINK-26215
Project: Flink
Yun Gao created FLINK-24896:
---
Summary: Failed to execute goal
com.github.siom79.japicmp:japicmp-maven-plugin:0.11.0:cmp (default) on project
flink-metrics-core
Key: FLINK-24896
URL: https://issues.apache.org/jira
Alok Singh created FLINK-24514:
--
Summary: Incorrect Flink Metrics on Job-Internal-Restart:
Key: FLINK-24514
URL: https://issues.apache.org/jira/browse/FLINK-24514
Project: Flink
Issue Type: Bug
Chesnay Schepler created FLINK-21773:
Summary: Remove dependency from flink-metrics-statsd
Key: FLINK-21773
URL: https://issues.apache.org/jira/browse/FLINK-21773
Project: Flink
Issue
Chesnay Schepler created FLINK-21772:
Summary: Remove dependency from flink-metrics-slf4j
Key: FLINK-21772
URL: https://issues.apache.org/jira/browse/FLINK-21772
Project: Flink
Issue
Chesnay Schepler created FLINK-21761:
Summary: Remove dependency from flink-metrics-influxdb
Key: FLINK-21761
URL: https://issues.apache.org/jira/browse/FLINK-21761
Project: Flink
Issue
Chesnay Schepler created FLINK-21762:
Summary: Remove dependency from flink-metrics-prometheus
Key: FLINK-21762
URL: https://issues.apache.org/jira/browse/FLINK-21762
Project: Flink
Chesnay Schepler created FLINK-21760:
Summary: Remove dependency from flink-metrics-jmx
Key: FLINK-21760
URL: https://issues.apache.org/jira/browse/FLINK-21760
Project: Flink
Issue Type
zhangyunyun created FLINK-18573:
---
Summary: plugins/metrics-influx/flink-metrics-influxdb-1.11.0.jar
META-INF has no dir named "services" , but "service"
Key: FLINK-18573
URL: https://issues.ap
Tammy zhang created FLINK-17556:
---
Summary: FATAL: Thread
'flink-metrics-akka.remote.default-remote-dispatcher-3' produced an uncaught
exception. Stopping the process... java.lang.OutOfMemoryError: Direct buffer
memory
Till Rohrmann created FLINK-16635:
-
Summary: Incompatible okio dependency in flink-metrics-influxdb
module
Key: FLINK-16635
URL: https://issues.apache.org/jira/browse/FLINK-16635
Project: Flink
static-max created FLINK-15832:
--
Summary: Artifact flink-metrics-core-tests will be uploaded twice
Key: FLINK-15832
URL: https://issues.apache.org/jira/browse/FLINK-15832
Project: Flink
Issue
Forward Xu created FLINK-15356:
--
Summary: Add applicationId to existing flink metrics running on
yarn
Key: FLINK-15356
URL: https://issues.apache.org/jira/browse/FLINK-15356
Project: Flink
ouyangwulin created FLINK-14831:
---
Summary: When edit flink-metrics-influxdb, need add metrics.md by
hand
Key: FLINK-14831
URL: https://issues.apache.org/jira/browse/FLINK-14831
Project: Flink
Luke Sun created FLINK-14332:
Summary: add flink-metrics-signalfx to flink-metrics
Key: FLINK-14332
URL: https://issues.apache.org/jira/browse/FLINK-14332
Project: Flink
Issue Type: New Feature
Hello,
I have been working on a flink project and need some help with the metric
system.
I have a logic inside a process function which side outputs a particular
message on certain failure parameters.
This process function has a parallelism > 1. How do I keep track of the
failed messages through
Armstrong Nova created FLINK-12423:
--
Summary: Add Timer metric type for flink-metrics module
Key: FLINK-12423
URL: https://issues.apache.org/jira/browse/FLINK-12423
Project: Flink
Issue
Fan weiwen created FLINK-11174:
--
Summary: flink Metrics Prometheus labels support chinese
Key: FLINK-11174
URL: https://issues.apache.org/jira/browse/FLINK-11174
Project: Flink
Issue Type
Till Rohrmann created FLINK-11014:
-
Summary: Relocate flink-metrics-graphite's dropwizard dependencies
Key: FLINK-11014
URL: https://issues.apache.org/jira/browse/FLINK-11014
Project:
Chesnay Schepler created FLINK-10998:
Summary: flink-metrics-ganglia has LGPL dependency
Key: FLINK-10998
URL: https://issues.apache.org/jira/browse/FLINK-10998
Project: Flink
Issue Type
Seth Wiesman created FLINK-10423:
Summary: Forward RocksDB memory metrics to Flink metrics reporter
Key: FLINK-10423
URL: https://issues.apache.org/jira/browse/FLINK-10423
Project: Flink
vinoyang created FLINK-10221:
Summary: Flink metrics documentation io section table layout error
Key: FLINK-10221
URL: https://issues.apache.org/jira/browse/FLINK-10221
Project: Flink
Issue Type
Nico Kruber created FLINK-10035:
---
Summary: ConcurrentModificationException with flink-metrics-slf4j
Key: FLINK-10035
URL: https://issues.apache.org/jira/browse/FLINK-10035
Project: Flink
Issue
Bowen Li created FLINK-8553:
---
Summary: switch flink-metrics-datadog to async mode
Key: FLINK-8553
URL: https://issues.apache.org/jira/browse/FLINK-8553
Project: Flink
Issue Type: Improvement
Colin Williams created FLINK-7907:
-
Summary: Flink Metrics documentation missing Scala examples
Key: FLINK-7907
URL: https://issues.apache.org/jira/browse/FLINK-7907
Project: Flink
Issue
etrics from Prometheus, I would like to use labels
>>> to differentiate them.
>>> Under the job/task/operator scope, it words fine to me. However, its not
>>> convenient to me to monitor partitions' states from Kakfa consumer,
>>> because
>>> I couldn&
set will be a unique metric in Prometheus.
It's hard to use visualization tool such as Grafana to monitor them.
My question is: Is it possible to add tags on Metric, instead of using
`.addGroup()`?
If not, will it be a new feature on Flink Metrics in the future? Since I
am not sure about how other
n is: Is it possible to add tags on Metric, instead of using
> `.addGroup()`?
> If not, will it be a new feature on Flink Metrics in the future? Since I
> am not sure about how other reporters work, I am afraid that it is not a
> good design to just fulfill the requirement on particular
> like current commit offset will be a unique metric in Prometheus. It's hard
> to use visualization tool such as Grafana to monitor them.
>
> My question is: Is it possible to add tags on Metric, instead of using
> `.addGroup()`?
> If not, will it be a new feature on Flink Me
will be a unique metric in Prometheus.
It's hard to use visualization tool such as Grafana to monitor them.
My question is: Is it possible to add tags on Metric, instead of using
`.addGroup()`?
If not, will it be a new feature on Flink Metrics in the future? Since I am
not sure about how other re
Chesnay Schepler created FLINK-6431:
---
Summary: Activate strict checkstyle for flink-metrics
Key: FLINK-6431
URL: https://issues.apache.org/jira/browse/FLINK-6431
Project: Flink
Issue Type
k that described Flink Matrices & provides example on how to
> utilize it pls?
> I really appreciate it...
> Cheers
>
> --
> *From:* Till Rohrmann
> *To:* u...@flink.apache.org
> *Cc:* dev@flink.apache.org
> *Sent:* Monday, October 17, 2016 12
Hi colleagues,Is there a link that described Flink Matrices & provides example
on how to utilize it pls?I really appreciate it...Cheers
From: Till Rohrmann
To: u...@flink.apache.org
Cc: dev@flink.apache.org
Sent: Monday, October 17, 2016 12:52 AM
Subject: Re: Flink Metrics
nstrumenting my pipeline with
> flink metrics. One small suggestion I have is currently the Meter interface
> only supports getRate() which is always the one minute rate.
>
> It would great if all the rates (1 min, 5 min & 15 min) are exposed to get
> a better picture in terms of
Hi,
I am currently using flink 1.2 snapshot and instrumenting my pipeline with
flink metrics. One small suggestion I have is currently the Meter interface
only supports getRate() which is always the one minute rate.
It would great if all the rates (1 min, 5 min & 15 min) are exposed to g
Robert Metzger created FLINK-4186:
-
Summary: Expose Kafka metrics through Flink metrics
Key: FLINK-4186
URL: https://issues.apache.org/jira/browse/FLINK-4186
Project: Flink
Issue Type
Till Rohrmann created FLINK-4173:
Summary: Replace maven-assembly-plugin by maven-shade-plugin in
flink-metrics
Key: FLINK-4173
URL: https://issues.apache.org/jira/browse/FLINK-4173
Project: Flink
61 matches
Mail list logo
