Hi,
multiple records are in the system at the same time, because Flink is
buffering records in various components, for efficiency reasons. That's why
you see that an individual record might have a latency of ~100ms, while
Flink is processing many more messages.
On Tue, Apr 5, 2022 at 12:54 PM lo
Hi,
I think that is not directly supported. After all, the main method can
also be executed outside of a JobManager and there you don't have any
Flink context/connections/components set up.
Best,
Dawid
On 08/07/2021 00:12, Mason Chen wrote:
> Hi all,
>
> Does Flink support reporting metrics fro
The isBackPressured metric is a Boolean -- it reports true or false, rather
than 1 or 0. The Flink web UI can not display it (it shows NaN); perhaps
the same is true for Datadog.
https://issues.apache.org/jira/browse/FLINK-15753 relates to this.
Regards,
David
On Tue, Apr 13, 2021 at 12:13 PM Cl
Thanks for your reply. I'm using Flink 1.12. I'm checking in Datadog and
the metric is not available there.
It has other task/operator metrics such as numRecordsIn/numRecordsOut there
but not the isBackPressured.
On Mon, Apr 12, 2021 at 8:40 AM Roman Khachatryan wrote:
> Hi,
>
> The metric is
Hi,
The metric is registered upon task deployment and reported periodically.
Which Flink version are you using? The metric was added in 1.10.
Are you checking it in the UI?
Regards,
Roman
On Fri, Apr 9, 2021 at 8:50 PM Claude M wrote:
>
> Hello,
>
> The documentation here
> https://ci.apache.
Yes, you can override notifyOnAddedMetric/notifyOnRemovedMetric to
ensure that a metric is logged at least once.
On 28.11.2018 16:01, bastien dine wrote:
Yea, that was I was thinking..
Batch can be quick
Can I report metric on "added" action ? (i should override the
notifyOnAddedMetric to repo
Yea, that was I was thinking..
Batch can be quick
Can I report metric on "added" action ? (i should override the
notifyOnAddedMetric to report ?)
--
Bastien DINE
Data Architect / Software Engineer / Sysadmin
bastiendine.io
Le mer. 28 nov. 2018 à 15:54, Chesnay Schepler a
écrit
How quick does job batch terminate? Metrics are unregistered once the
job ends; if the job duration is shorter than the report interval they
may never be exposed.
On 28.11.2018 15:18, bastien dine wrote:
Hello Chesnay,
Thanks for your response !
I have logs enable (info), slf4jReporter is wor
Hello Chesnay,
Thanks for your response !
I have logs enable (info), slf4jReporter is working, I can see :
15:16:00.112 [Flink-MetricRegistry-thread-1] INFO
org.apache.flink.metrics.slf4j.Slf4jReporter -
=== Starting metrics report
===
-- Counters
Please enable WARN logging and check for warnings by the SLF4JReporter
and/or MetricQueryService.
On 27.11.2018 17:00, bastien dine wrote:
Hello everyone,
Once again I require your help !
I am trying to report custom metric (see my code below)
Yet, I do not see them anywhere.. nor in the metri
10 matches
Mail list logo
