Hi Averell,
From what I understand for your use case, it is possible to do what you want
with Flink.
If you are implementing a function, then you have access to the metric system
through
the runtime context (see [1] for more information).
Some things to take into consideration:
1) Metrics are not fault-tolerant, so if you need fault-tolerance then you have
to take care of that
(e.g. keep them in Flink’s state).
2) Are you sure you want them as metrics and not something like side-output?
Metrics are more
supposed to monitor the health of you cluster and more “system”
characteristics, rather than
business logic or data properties.
Cheers,
Kostas
[1]
https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html
<https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html>
> On Sep 27, 2018, at 8:45 AM, Averell <[email protected]> wrote:
>
> Good day everyone,
>
> I have a stream with two timestamps (ts1 and ts2) inside each record. My
> event time is ts1. This ts1 has value truncated to a quarter (like 23:30,
> 23:45, 00:00,...)
> I want to report two metrics:
> 1. A meter which counts number of records per value of ts1. (fig.1)
>
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/t1586/Meter.png>
>
>
> 2. A histogram which shows the distribution of the difference between ts1
> and ts2 within each record (fig.2)
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/t1586/heatmap_histogram.png>
>
>
> I'm using Prometheus with Grafana. Is that possible to do what I mentioned?
>
> Thanks and best regards,
> Averell
>
>
>
> --
> Sent from:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
