I'm not 100% certain what "alignment duration" is measuring exactly in the context of unaligned checkpoints -- however, even with unaligned checkpointing each operator still has to wait until all of the barriers are present in the operator's input queues. It doesn't have to wait for the barriers to be aligned, but they do have to all be present in order for the operator to know which in-flight messages to include in the checkpoint.
David On Fri, Jun 2, 2023 at 12:38 PM Pritam Agarwala <pritamagarwala...@gmail.com> wrote: > > Hi All, > > > I have enabled checkpointing in production. In peak hours, checkpointing is > falling due to timeout. When checked in sub-task level , I could see it is > taking some time for alignment and there is also a start delay. I think the > start delay will be due to back-pressure. > As a first step , I have enabled unalignment checkpointing in my test env. > But I could still see it is taking time for alignment. Is this expected > behaviour. ?? > > Screenshot for your reference: > In test environment: > > > In prod environment : > > > > > > > Thanks & Regards, > Pritam >
