Hello,

the Metric System <https://ci.apache.org/projects/flink/flink-docs-release-1.4/monitoring/metrics.html> should be exactly what you're looking for.

On 15.11.2017 03:55, Nomchin Banga wrote:
Hi

We are a group of graduate students from Purdue University who are doing an experimental study to compare different data ingestion engines.

For this purpose, we are trying to collect statistics of running jobs over a few days. However, Flink’s UI captures the statistics for the last 5 minutes. We tried to hit the Rest API but that does not contain the data of statistics other than bytes read/written.

It would be very helpful if you could guide us regarding a way in which we can capture the entire history of metrics.

Looking forward to hearing from you

Regards
Nomchin Banga


Reply via email to