Hi everyone, FLIP-58 adds the support for Python UDFs, but user-defined metrics have not been supported yet. With metrics, users can report and monitor the UDF status to get a deeper understanding of the execution, so in this FLIP, we want to support metrics for Python UDFs.
Previously, Jincheng and I discussed offline about the support of metrics for Python UDFs. We'd like to achieve three goals for supporting metrics for Python UDFs: - Support user-defined metrics including Counters, Gauges, Meters, Distributions in Python UDFs. - Support defining user scopes. - Support defining user variables. More details can be found in the FLIP wiki page[1] and we are looking forward to your feedback. Best, Hequn [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-112%3A+Support+User-Defined+Metrics+in++Python+UDF