Re: Graceful Task Manager Termination and Replacement

Hi Yu, That's a great proposal. Wish to see this feature soon! On Mon, Jul 29, 2019 at 4:59 PM Yu Li wrote: > Belated but FWIW, besides the region failover and best-efforts failover > efforts, I believe stop with checkpoint as proposed in FLINK-12619 and > FLIP-45 could also help here, FYI. > >

Re: Graceful Task Manager Termination and Replacement

Belated but FWIW, besides the region failover and best-efforts failover efforts, I believe stop with checkpoint as proposed in FLINK-12619 and FLIP-45 could also help here, FYI. W.r.t k8s, there're also some offline discussion about supporting local recovery with persistent volume even when task a

Re: Graceful Task Manager Termination and Replacement

I was on vacation but wanted to thank Biao for summarizing the current state! Thanks! On Mon, Jul 15, 2019 at 2:00 AM Biao Liu wrote: > Hi Aaron, > > From my understanding, you want shutting down a Task Manager without > restart the job which has tasks running on this Task Manager? > > Based on

Re: Graceful Task Manager Termination and Replacement

Hi Aaron, >From my understanding, you want shutting down a Task Manager without restart the job which has tasks running on this Task Manager? Based on current implementation, if there is a Task Manager is down, the tasks on it would be treated as failed. The behavior of task failure is defined vi

Re: Graceful Task Manager Termination and Replacement

Hi, Maybe region restart strategy can help. It restarts minimum required tasks. Note that it’s recommended to use only after 1.9 release, see [1], unless you’re running a stateless job. [1] https://issues.apache.org/jira/browse/FLINK-10712 B

Re: Graceful Task Manager Termination and Replacement

I have a common interest in this topic. My k8s recycle hosts, and I am facing the same issue. Flink can tolerate this situation, but I am wondering if I can do better On Thu, Jul 11, 2019, 12:39 Aaron Levin wrote: > Hello, > > Is there a way to gracefully terminate a Task Manager beyond just kil