Re: rebalance of streaming job after taskManager restart

2016-03-08 Thread Aljoscha Krettek
Yes, there are plans to make this more streamlined but we are not there yet, unfortunately. > On 08 Mar 2016, at 16:07, Maciek Próchniak wrote: > > Hi, > > thanks for quick answer - yes, I does what I want to accomplish, > but I was hoping for some "easier" solution. > Are there any plans for "

Re: rebalance of streaming job after taskManager restart

2016-03-08 Thread Maciek Próchniak
Hi, thanks for quick answer - yes, I does what I want to accomplish, but I was hoping for some "easier" solution. Are there any plans for "restart" button/command or sth similar? I mean, the whole process of restarting is ready as I understand - as it's triggered when task manager dies. thank

Re: rebalance of streaming job after taskManager restart

2016-03-08 Thread Aljoscha Krettek
Hi, I think what you can do is make a savepoint of your program, then cancel it and restart it from the savepoint. This should make Flink redistribute it on all TaskManagers. See https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/savepoints.html and https://ci.apache.org/proj

rebalance of streaming job after taskManager restart

2016-03-08 Thread Maciek Próchniak
Hi, we have streaming job with paralelism 2 and two task managers. The job is occupying one slot on each task manager. When I stop manager2 the job is restarted and it runs on manager1 - occupying two of it's slots. How can I trigger restart (or other similar process) that will cause the job t