59
To: Zhanghao Chen
Cc: Gyula Fóra ; Oscar Perez via user
Subject: Re: Understanding flink-autoscaler behavior
Hello,
After disabling the adaptive scheduler, I was able to have the operator stop
the job with a savepoint, and resume the job from that savepoint after the
upgrade. However I observed
cation-upgrades
>>
>>
>> Best,
>> Zhanghao Chen
>> --
>> *From:* Chetas Joshi
>> *Sent:* Thursday, June 13, 2024 6:33
>> *To:* Zhanghao Chen
>> *Cc:* Sachin Sharma ; Gyula Fóra <
>> gyula.f...@gmail.com>; O
ursday, June 13, 2024 6:33
> *To:* Zhanghao Chen
> *Cc:* Sachin Sharma ; Gyula Fóra <
> gyula.f...@gmail.com>; Oscar Perez via user
>
> *Subject:* Re: Understanding flink-autoscaler behavior
>
> Hi Zhanghao,
>
> If I am using the autoscaler (flink-k8s-operator) wi
anagement/#stateful-and-stateless-application-upgrades
Best,
Zhanghao Chen
From: Chetas Joshi
Sent: Thursday, June 13, 2024 6:33
To: Zhanghao Chen
Cc: Sachin Sharma ; Gyula Fóra ;
Oscar Perez via user
Subject: Re: Understanding flink-autoscaler behavior
Hi Zhang
.8/docs/custom-resource/autoscaler/
>
>
> Best,
> Zhanghao Chen
> --
> *From:* Sachin Sharma
> *Sent:* Saturday, June 8, 2024 3:02
> *To:* Gyula Fóra
> *Cc:* Chetas Joshi ; Oscar Perez via user <
> user@flink.apache.org>
> *Subje
8, 2024 3:02
To: Gyula Fóra
Cc: Chetas Joshi ; Oscar Perez via user
Subject: Re: Understanding flink-autoscaler behavior
Hi,
I have a question related to this.
I am doing a POC with Kubernetes operator 1.8 and flink 1.18 version with
Reactive mode enabled, I added some dummy slow and fast opera
Hi,
I have a question related to this.
I am doing a POC with Kubernetes operator 1.8 and flink 1.18 version with
Reactive mode enabled, I added some dummy slow and fast operator to the
flink job and i can see there is a back pressure accumulated. but i am not
sure why my Flink task managers are n
Hi!
To simplify things you can generally look at TRUE_PROCESSING_RATE,
SCALUE_UP_RATE_THRESHOLD and SCALE_DOWN_RATE_THRESHOLD.
If TPR is below the scale up threshold then we should scale up and if its
above the scale down threshold then we scale down.
In your case what we see for your source (cbc
Hi Community,
I want to understand the following logs from the flink-k8s-operator
autoscaler. My flink pipeline running on 1.18.0 and using
flink-k8s-operator (1.8.0) is not scaling up even though the source vertex
is back-pressured.
2024-06-06 21:33:35,270 o.a.f.a.ScalingMetricCollector
[DEBUG]
