Hi Flink team,

This is Lijuan. I am working on our flink job to realize autoscaling. We are 
currently using flink version of 1.16.1, and using flink operator version of 
1.5.0. I have some questions need to confirm with you.

1 - It seems for flink job using flink operator to realize autoscaling, the 
only option to realize autoscaling is to enable the Autoscaler feature, and 
KEDA won’t work, right?

2 - I noticed from the document that we need to upgrade to flink version of 
1.17 to use Autoscaler. But I also noticed that the updated version for flink 
operator is 1.7 now.
Shall we upgrade from 1.5.0 to 1.7 to enable Autoscaler?

3 – I have done a lot of search, and also read the Autoscaler Algorithm page. 
But I am still not very sure about the list of metrics observed automatically.

  *   Will it include CPU load, memory, throughput and kafka consumer lag? 
Could you please provide the whole list of monitored metrics?

-          Is this config related to kafka consumer lag?
kubernetes.operator.job.autoscaler.backlog-processing.lag-threshold
Thanks a lot for the help!

Best,
Lijuan


Reply via email to