Could you describe a situation in which hand-tuning the parallelism of individual operators produces significantly better throughput than the default approach? I think it would help this discussion if we could have a specific use case in mind where this is clearly better.
Regards, David On Tue, May 4, 2021 at 12:29 PM vishalovercome <vis...@moengage.com> wrote: > Forgot to add one more question - 7. If maxParallelism needs to be set to > control parallelism, then wouldn't that mean that we wouldn't ever be able > to take a savepoint and rescale beyond the configured maxParallelism? This > would mean that we can never achieve hand tuned resource efficient. I will > need to set maxParallelism beyond the current parallelism and given current > tendency to allocate same number of sub-tasks for each operator, I will > inevitably end up with several under utilized operators. > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >
