I am also using exactly once checkpointing mode, I have a kafka source and sink so both support transactions which should allow for exactly once processing. Is this the reason why there is only one checkpoint retained ?
Thanks, Vishwas On Wed, Aug 21, 2019 at 5:26 PM Vishwas Siravara <vsirav...@gmail.com> wrote: > Hi peeps, > I am externalizing checkpoints in S3 for my flink job and I retain them on > cancellation. However when I look into my S3 bucket where the checkpoints > are stored there is only 1 checkpoint at any point in time . Is this the > default behavior of flink where older checkpoints are deleted when the > current checkpoint completes ? Here are a few screenshots. What are your > thoughts on restoring an older state which is not the previous state ? > > List contents of bucket at time 0 > > Object Name: > checkpoints/fb9fea316bf2d530a6fc54ea107d66d4/chk-6/6af4f345-49e0-4ae1-baae-1f7c4d71ebf4Last > modified time : Wed Aug 21 22:17:23 GMT 2019 > Object Name: checkpoints/fb9fea316bf2d530a6fc54ea107d66d4/chk-6/_metadataLast > modified time : Wed Aug 21 22:17:24 GMT 2019 > > List contents of bucket at time 1 > > Printing last modified times > Object Name: > checkpoints/fb9fea316bf2d530a6fc54ea107d66d4/chk-12/7cf17042-7790-4909-9252-73511d93f518Last > modified time : Wed Aug 21 22:23:24 GMT 2019 > Object Name: > checkpoints/fb9fea316bf2d530a6fc54ea107d66d4/chk-12/_metadataLast modified > time : Wed Aug 21 22:23:24 GMT 2019 > > Thanks, > > Vishwas > >
