Re: Unaligned Checkpoint and Exactly Once

2020-06-22 Thread Arvid Heise
ithout blocking any channels. > > -- > From:Lu Weizheng > Send Time:2020年6月22日(星期一) 10:53 > To:Zhijiang ; user@flink.apache.org < > user@flink.apache.org> > Subject:回复: Unaligned Checkpoint and Exactly Once >

Re: Unaligned Checkpoint and Exactly Once

2020-06-21 Thread Zhijiang
:2020年6月22日(星期一) 10:53 To:Zhijiang ; user@flink.apache.org Subject:回复: Unaligned Checkpoint and Exactly Once Thank you Zhijiang! The second question about config is just because I find a method in InputProcessorUtil. I guess AT_LEAST_ONCE mode is a simpler way to handle checkpont barrier

回复: Unaligned Checkpoint and Exactly Once

2020-06-21 Thread Lu Weizheng
); default: throw new UnsupportedOperationException("Unrecognized Checkpointing Mode: " + config.getCheckpointMode()); } } 发件人: Zhijiang 发送时间: 2020年6月22日 10:41 收件人: Lu Weizheng ; user@flink.apache.org 主题: Re: Unaligned Checkpoint and Exactl

Re: Unaligned Checkpoint and Exactly Once

2020-06-21 Thread Zhijiang
Hi Weizheng, The unaligned checkpoint (UC) only supports exactly-once mode in Flink 1.11 except savepoint mode. The savepoint is probably used in job rescaling scenario and we plan to support it in future release version. Of course UC can satisfy exactly-once semantic as promised. Regarding th

Unaligned Checkpoint and Exactly Once

2020-06-21 Thread Lu Weizheng
Hi there, The new feature in Flink 1.11 will provide us the Unaligned Checkpoint which means a operator subtask does not need to wait all the Checkpoint barrier and will not block some channels. As the Checkpoint barrier is the key mechanism for Exactly Once guarantee, I am not sure Unaligned C