How many taskmanagers and server do you have?
Can you also share the task managers page of flink dashboard?
On Mon, Apr 15, 2024 at 10:58 AM Oscar Perez via user
wrote:
> Hi community!
>
> We have an interesting problem with Flink after increasing parallelism in
> a certain way. Here is the sum
almost full, could you try allocating more CPUs and see if the
> instability persists?
>
> Best,
> Zhanghao Chen
> --
> *From:* Oscar Perez
> *Sent:* Monday, April 15, 2024 19:24
> *To:* Zhanghao Chen
> *Cc:* Oscar Perez via user
> *Subject:*
instability persists?
Best,
Zhanghao Chen
From: Oscar Perez
Sent: Monday, April 15, 2024 19:24
To: Zhanghao Chen
Cc: Oscar Perez via user
Subject: Re: Flink job performance
Hei, ok that is weird. Let me resend them.
Regards,
Oscar
On Mon, 15 Apr 2024 at 14:00, Zhanghao
Hi, there seems to be sth wrong with the two images attached in the latest
email. I cannot open them.
Best,
Zhanghao Chen
From: Oscar Perez via user
Sent: Monday, April 15, 2024 15:57
To: Oscar Perez via user ; pi-team ;
Hermes Team
Subject: Flink job performan
Hi Oscar,
The rebalance operation will go over the network stack, but not necessarily
involving remote data shuffle. For data shuffling between tasks of the same
node, the local channel is used, but compared to chained operators, it still
introduces extra data serialization overhead. For data s
