Answered in another mailing list

Hi Shachar, 

with Flink 1.5 we added resource elasticity. This means that Flink is now 
able to allocate new containers on a cluster management framework like Yarn 
or Mesos. Due to these changes (which also apply to the standalone mode), 
Flink no longer reasons about a fixed set of TaskManagers because if needed 
it will start new containers (does not work in standalone mode). Therefore, 
it is hard for the system to make any decisions about spreading slots 
belonging to a single job out across multiple TMs. It gets even harder when 
you consider that some jobs like yours might benefit from such a strategy 
whereas others would benefit from co-locating its slots. It gets even more 
complicated if you want to do scheduling wrt to multiple jobs which the 
system does not have full knowledge about because they are submitted 
sequentially. Therefore, Flink currently assumes that slots requests can be 
fulfilled by any TaskManager. 

Cheers, 
Till 



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Reply via email to