Re: [External] checkpoint metadata not in configured directory state.checkpoints.dir

Hi Vishal Maybe the slide[1] (page 40) can be helpful [1] https://files.alicdn.com/tpsservice/c421720fcb1c51026257cd770923844a.pdf Best, Congxian Vishal Sharma 于2019年6月20日周四 下午5:42写道： > Hi Congxian, > > I am not sure how can I track the checkpoint path. Can you suggestion > regarding this ? >

Re: [External] checkpoint metadata not in configured directory state.checkpoints.dir

Hi Congxian, I am not sure how can I track the checkpoint path. Can you suggestion regarding this ? Thanks, Vishal Sharma On Thu, Jun 20, 2019 at 11:17 AM Congxian Qiu wrote: > Hi, Vishal > If you want to restart from the last competed external checkpoint of the > previous stoped job, you need

Re: [External] checkpoint metadata not in configured directory state.checkpoints.dir

Hi, Vishal If you want to restart from the last competed external checkpoint of the previous stoped job, you need to track the checkpoint path and restart from it. [1] https://ci.apache.org/projects/flink/flink-docs-release-1.8/ops/state/checkpoints.html#resuming-from-a-retained-checkpoint Best,

Re: [External] checkpoint metadata not in configured directory state.checkpoints.dir

Hi Chesnay, Can you suggest, How should I go about automating job restart from last completed externalised checkpoint in case of failure ? I am not sure about the path for the latest completed checkpoint. Thanks, Vishal Sharma On Wed, Jun 19, 2019 at 11:11 PM Chesnay Schepler wrote: > The _met

Re: [External] checkpoint metadata not in configured directory state.checkpoints.dir

The _metadata is always stored in the same directory as the checkpoint data. As outlined here "state.checkpoints.dir" serves as a cluster-wide configuration that _can_ be overwritten with a

[External] checkpoint metadata not in configured directory state.checkpoints.dir

Hi Folks, I am using flink 1.8 with externalised checkpointing enabled and saving the checkpoints to aws S3. My configuration is as follows : flink-conf.yaml : state.checkpoints.dir: s3a://test-bucket/checkpoint-metadata In application code : env.setStateBackend(new RocksDBStateBackend("s3a://t