Hi all, I'd like start a discussion on FLIP-460: Display source/sink I/O metrics on Flink Web UI [1].
Currently, the numRecordsIn & numBytesIn metrics for sources and the numRecordsOut & numBytesOut metrics for sinks are always 0 on the Flink web dashboard. It is especially confusing for simple ETL jobs where there's a single chained operator with 0 input rate and 0 output rate. For years, Flink newbies have been asking "Why my job has zero consumption rate and zero production rate, is it actually working?" Connectors implementing FLIP-33 [2] have already exposed these metrics on the operator level, this FLIP takes a further step to expose them on the job overview page on Flink Web UI. Looking forward to everyone's feedback and suggestions. Thanks! [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=309496355 [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-33%3A+Standardize+Connector+Metrics Best, Zhanghao Chen
