Re: yarn and checkpointing

2017-08-29 Thread Chesnay Schepler
Checkpoints are only used for recovery during the job execution. If the entire cluster is shutdown and restarted you will need to take a savepoint and restore from that. On 29.08.2017 16:46, Gwenhael Pasquiers wrote: Hi, Is it possible to use checkpointing to restore the state of an app afte

yarn and checkpointing

2017-08-29 Thread Gwenhael Pasquiers
Hi, Is it possible to use checkpointing to restore the state of an app after a restart on yarn ? From what I've seen it looks like that checkpointing only works within a flink cluster life-time. However the yarn mode has one cluster per app, and (unless the app crashes and is automatically res