Hi Prasanna,
IIUC, your screenshot shows the scaling feature of an EMR cluster, not
Flink.
Let me try to better understand your question. Which kind of rescaling do
you need?
- If you deploy a long running streaming job, and want it to dynamically
rescale based on the real-time incoming data stre
Thanks Xintong and Yu Yang for the replies,
I see AWS provides deploying Flink on EMR out of the box. There they have
an option of EMR cluster scaling based on the load.
Is this not equal to dynamic rescaling ?
[image: Screen Shot 2020-06-15 at 9.23.24 AM.png]
https://docs.aws.amazon.com/emr/l
Hi Prasanna,
Flink does not support dynamic rescaling at the moment.
AFAIK, there are some companies in China already have solutions for dynamic
scaling Flink jobs (Alibaba, 360, etc.), but none of them are yet available
to the community version. These solutions rely on an external system to
moni
Hi all,
Does flink support dynamic scaling. Say try to add/reduce nodes based upon
incoming load.
Because our use case is such that we get peak loads for 4 hours and then
medium loads for 8 hours and then light to no load for rest 2 hours.
Or peak load would be atleast 5 times the medium load.
