Hi Biao, Thanks for creating this FLIP! Supporting speculative execution of sinks is important. Also In production we see sinks chaining with other operators, e.g. sources in simple ETL jobs, and currently the task cannot do speculative execution due to sinks are not supported.
+1 for the proposal. Thanks, Zhu Biao Liu <mmyy1...@gmail.com> 于2022年12月22日周四 20:16写道: > > Hi everyone, > > I would like to start a discussion about making Sink support speculative > execution for batch jobs. This proposal is a follow up of "FLIP-168: > Speculative Execution For Batch Job"[1]. Speculative execution is very > meaningful for batch jobs. And it would be more complete after supporting > speculative execution of Sink. Please find more details in the FLIP document > [2]. > > Looking forward to your feedback. > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-168%3A+Speculative+Execution+for+Batch+Job > [2] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-281+Sink+Supports+Speculative+Execution+For+Batch+Job > > Thanks, > Biao /'bɪ.aʊ/