Hello, I am running a Flink streaming pipeline with autscaler on AWS EMR (as a YARN application). My tasks are scaling independently based on load.
My question is how can I get the metric, say numRecordsInPerSecond, at the task level. Basically it should sum all the values for this metric at sub task level and provide my once consolidated value. This way I can provide uniform reporting irrespective of the number of sub tasks that get created at different points in time. Thanks Sachin