Hi, all:
As discussed in FLIP-147 [1], checkpoints are supported after tasks finished, 
but metrics not. As we known, metricReporters are reported periodically, 
default 10 seconds. 
If sources are bounded, the final metrics may not be reported to metric system 
like pushgateway when task finished. This makes users unable to obtain the 
correct metrics。


I have created a JIRA[2] before, but at that time the indicator system of flink 
was considered to be used to monitor a running application. But now in Flink 
1.14, 
batch and stream processing are unified. I think it's also important to get the 
metrics of bounded or mixed jobs even if those jobs are finished.


Therefore, we propose to also proactively push metrics after tasks finished.


Thanks, hope for your response.


[1]  
https://cwiki.apache.org/confluence/display/FLINK/FLIP-147%3A+Support+Checkpoints+After+Tasks+Finished
[2]  https://issues.apache.org/jira/browse/FLINK-22631




 

Reply via email to