Hello Team,
I would like to understand if there's a way flink can rescale automatically by
adjusting parallelism based on incoming traffic.
For example, when a job starts incoming TPS is around 100 which can be
processed with parallelism 4, and when TPS increased 1000 I might need to
rescale flink to use parallelism 10 or 20.
Is there a way we can set min and max parallelism to flink application which
can adjust automatically based on incoming load with stop and starting job with
new config.
I assume Kubernetes automatically does by changing replicas but all our
applications are running on yarn as of today.
Regards,Madan
