Re: [DISCUSS] Backtracking for failover regions

2019-04-15 Thread Zhu Zhu
Thanks to Chesnay for bringing up this proposal. It's good news that we can have a applicable fine grained recovery for batch jobs soon. +1 for this proposal. Regards, Zhu Till Rohrmann 于2019年4月15日周一 下午5:57写道: > Thanks for summarizing the current state of Flip-1 and outlining the way to > move

Re: [DISCUSS] Backtracking for failover regions

2019-04-15 Thread Till Rohrmann
Thanks for summarizing the current state of Flip-1 and outlining the way to move forward with it Chesnay. I think we should implement the first version of the backtracking logic using the DataConsumptionException (FLINK-6227) to signal if an intermediate result partition has been lost. Moreover,

[DISCUSS] Backtracking for failover regions

2019-04-14 Thread Chesnay Schepler
Hello everyone, Till, Zhu Zhu and myself have prepared a Design Document for introducing backtracking for failover regions. This is an optimization of the failure handling logic for jobs with blocking result par