Re: Isolate Tasks - Run Distinct Tasks in Different Task Managers

2017-03-14 Thread Stephan Ewen
Yes, simply set the number of slots per TaskManager in YARN to 1. That gives you the isolation. On Tue, Mar 14, 2017 at 11:58 AM, PedroMrChaves wrote: > Can YARN provide task isolation? > > > > > - > Best Regards, > Pedro Chaves > -- > View this message in context: http://apache-flink-user-

Re: Isolate Tasks - Run Distinct Tasks in Different Task Managers

2017-03-14 Thread PedroMrChaves
Can YARN provide task isolation? - Best Regards, Pedro Chaves -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Isolate-Tasks-Run-Distinct-Tasks-in-Different-Task-Managers-tp12104p12201.html Sent from the Apache Flink User Mailing List arc

Re: Isolate Tasks - Run Distinct Tasks in Different Task Managers

2017-03-10 Thread Robert Metzger
There is currently no way in Flink to define such scheduling constraints. On Wed, Mar 8, 2017 at 5:00 PM, PedroMrChaves wrote: > Thanks for the response. > > I would like to assure that the map operator is not in the same task > manager > as the window/apply operator, regardless of the number of

Re: Isolate Tasks - Run Distinct Tasks in Different Task Managers

2017-03-08 Thread PedroMrChaves
Thanks for the response. I would like to assure that the map operator is not in the same task manager as the window/apply operator, regardless of the number of slots of each task manager. - Best Regards, Pedro Chaves -- View this message in context: http://apache-flink-user-mailing-list-a

Re: Isolate Tasks - Run Distinct Tasks in Different Task Managers

2017-03-08 Thread Ufuk Celebi
Internally, Flink defines through SlotSharingGroup which tasks may share a task manager slot. By configuring each TaskManager to have a single slot and configuring the slot sharing groups accordingly, you can get the desired behaviour. You can specify the slot sharing group for an operator like ma