Hello,
I'm creating a beam pipeline to run on flink runner. I've created
custom metrics in beam(JAVA SDK). But I'm unable to see it in flink
dashboard or flink rest API response. Although I'm able to see under
Accumulators section but not under metrics. Under accumulators I can see,
{ "metrics": { "attempted": [{ "urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1", "payload": "FA==", "labels": {
"NAMESPACE": "Bingo", "NAME": "bingotest", "PTRANSFORM":
"log/ParMultiDo(LogOutput)" } }] } }
I'm also able to log the metrics in beam part.
I'm using Apache Beam 2.55.0 and Flink runner 1.16.
Please let me know if this is the correct way to do this or am I missing
something?
Do I need to create a separate HTTP sink for this as mentioned here
<https://beam.apache.org/documentation/programming-guide/#metrics> ?. But I
couldn't find any other documentation to export data. Could you please help
me here?
Thank you!
