Hello, We are working on a Flink project which uses FileSource to discover and read Parquet Files from GCS. ( using Flink 1.14)
As part of this, we wanted to implement some health metrics around the code. I wanted to know whether Flink gathers some metrics by itself around FileSource, e;g, number of files discovered by the SplitEnumerator, number of files added back to SplitAssigner, time taken to process per split, etc ? I checked in the official documentation <https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/filesystem/> but there doesn't appear to be. Is the solution then to implement custom metrics like this <https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/ops/metrics/> ? *Regards,* *Meghajit*