Hi all!

I would like to open up for discussion a new FLIP-484 [1].

Motivation
When running a Flink job that reads data from multiple sources and writes
to multiple sinks, it would be helpful to group metrics from each
source/sink instance together, for example based on the underlying name of
the source/sink table/topic.

Proposed Changes
This flip proposes to allow users to set custom metric variables to
operators/transformations, that will be later passed on to the metrics and
trace reporters.

This will allow users to label all of the reported metrics from operators
with for example the table name (SQL), allowing to easily report the number
of records/watermark values per each source/sink table in the same Flink
Job.

For more information please look into the FLIP-484 [1].

I'm looking forward to your thoughts on this.

Best,
Piotrek

[1] https://cwiki.apache.org/confluence/x/44yMEw
<https://cwiki.apache.org/confluence/x/4IyMEw>

Reply via email to