I'm using Uber Open Source project Athenax. As mentioned in it's docs[1] it supports `Auto scaling for AthenaX jobs`. I went through the source code on Github but didn't find the auto scaling part. Can someone aware of this project please point me in the right direction here.
I'm using Flink's Table API (Flink 1.4.2) and submit my jobs programatically to the Yarn Cluster. All the JM and TM metric are saved in Prometheus. I am thinking of using these metric to develop an algo to re-scale jobs. I would also appreciate if someone could share how they developed there auto-scaling part. [1] https://athenax.readthedocs.io/en/latest/ <https://athenax.readthedocs.io/en/latest/> -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
