Re: [External] Is there a way to get consolidated metrics at task level

So how can we aggregate same metric across all the sub tasks ? Say: Task_0 is outputting a value for numRecordsInPerSecond Task_1 is outputting a value for numRecordsInPerSecond I want to consolidate numRecordsInPerSecond for the entire task which would be the sum of these values for all the numb

RE: [External] Is there a way to get consolidated metrics at task level

Hi Sachin, Happy new year … 😊 On Yarn we setup prometheus push gateway on one machine and the have al task managers export their monitoring to this push gateway. Then Prometheus would collect all metrics from push gateway. On yarn, the main problem is missing isolation of workloads and thus you