I'm trying to understand a behavior of Flink in case of heterogeneous
operations. For example in our pipelines some operation might accumulate
large windows while another performs high latency calls to external
services. Obviously the former needs task slot with a large memory
allocation, while the latter needs no memory but a high degree of
parallelism.

Is any way to have different slot types and control allocation of
operations to them? May be is there another way to ensure good hardware
utilization?

Also from the documentation it is not clear if memory of a TaskManager is
shared across all tasks running on it or each task gets its quota. Could
you clarify it?

Thanks,

Maxim.

Reply via email to