RE: [External] Re: Is there a way to get consolidated metrics at task level

2025-01-06 Thread Schwalbe Matthias
Thias From: Sachin Mittal mailto:sjmit...@gmail.com>> Sent: Monday, January 6, 2025 10:42 AM To: user mailto:user@flink.apache.org>> Subject: [External] Is there a way to get consolidated metrics at task level ⚠EXTERNAL MESSAGE – CAUTION: Think Before You Click ⚠ Hello, I am running

Re: [External] Is there a way to get consolidated metrics at task level

2025-01-06 Thread Sachin Mittal
ope this helps > > > > Thias > > > > > > > > > > *From:* Sachin Mittal > *Sent:* Monday, January 6, 2025 10:42 AM > *To:* user > *Subject:* [External] Is there a way to get consolidated metrics at task > level > > > > ⚠*EXTERNAL MESSAG

RE: [External] Is there a way to get consolidated metrics at task level

2025-01-06 Thread Schwalbe Matthias
you easily run into port conflicts … Hope this helps Thias From: Sachin Mittal Sent: Monday, January 6, 2025 10:42 AM To: user Subject: [External] Is there a way to get consolidated metrics at task level ⚠EXTERNAL MESSAGE – CAUTION: Think Before You Click ⚠ Hello, I am running a Flink

Is there a way to get consolidated metrics at task level

2025-01-06 Thread Sachin Mittal
Hello, I am running a Flink streaming pipeline with autscaler on AWS EMR (as a YARN application). My tasks are scaling independently based on load. My question is how can I get the metric, say numRecordsInPerSecond, at the task level. Basically it should sum all the values for this metric at sub t