Adding Jan & Ken as people with potential knowledge in this area.
On Sun, Oct 20, 2024 at 10:43 PM Aditya Shirsath <[email protected]>
wrote:
> Hello,
>
> I'm creating a beam pipeline to run on flink runner. I've created
> custom metrics in beam(JAVA SDK). But I'm unable to see it in flink
> dashboard or flink rest API response. Although I'm able to see under
> Accumulators section but not under metrics. Under accumulators I can see,
>
> { "metrics": { "attempted": [{ "urn": "beam:metric:user:sum_int64:v1",
> "type": "beam:metrics:sum_int64:v1", "payload": "FA==", "labels": {
> "NAMESPACE": "Bingo", "NAME": "bingotest", "PTRANSFORM":
> "log/ParMultiDo(LogOutput)" } }] } }
>
> I'm also able to log the metrics in beam part.
> I'm using Apache Beam 2.55.0 and Flink runner 1.16.
>
> Please let me know if this is the correct way to do this or am I missing
> something?
>
> Do I need to create a separate HTTP sink for this as mentioned here
> <https://beam.apache.org/documentation/programming-guide/#metrics> ?. But
> I couldn't find any other documentation to export data. Could you please
> help me here?
>
> Thank you!
>
