Hi all, I and Samrat(cc'ed) created the FLIP-334[1] to decoupling the autoscaler and kubernetes.
Currently, the flink-autoscaler is tightly integrated with Kubernetes. There are compelling reasons to extend the use of flink-autoscaler to more types of Flink jobs: 1. With the recent merge of the Externalized Declarative Resource Management (FLIP-291[2]), in-place scaling is now supported across all types of Flink jobs. This development has made scaling Flink on YARN a straightforward process. 2. Several discussions[3] within the Flink user community, as observed in the mail list , have emphasized the necessity of flink-autoscaler supporting Flink on YARN. Please refer to the FLIP[1] document for more details about the proposed design and implementation. We welcome any feedback and opinions on this proposal. [1] https://cwiki.apache.org/confluence/x/x4qzDw [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-291%3A+Externalized+Declarative+Resource+Management [3] https://lists.apache.org/thread/pr0r8hq8kqpzk3q1zrzkl3rp1lz24v7v