Re: Question regarding rescale api

2018-12-10 Thread Till Rohrmann
Hi Mingliang, Aljoscha is right. At the moment Flink does not support to spread out tasks across all TaskManagers. This is a feature which we still need to add. Until then, you need to set the parallelism to the number of available slots in order to guarantee that all TaskManagers are equally used

Re: Question regarding rescale api

2018-12-10 Thread Aljoscha Krettek
Hi, I think with how currently the assignment of tasks to slots works there is no way of ensuring that the source tasks are evenly spread to the TaskManagers (TaskExecutors). The rescale() API is from a time where scheduling worked a bit different in Flink, I'm afraid. I'm cc'ing Till, who mig