Re: FileNotFoundException when restoring checkpoint

2017-07-17 Thread Stefan Richter
After giving it a second thought, this problem could a side effect of the issue fixed in https://issues.apache.org/jira/browse/FLINK-6964 . If you want, you can try if your problem is fixed in the latest master. This fix will also go into the 1.

Re: FileNotFoundException when restoring checkpoint

2017-07-17 Thread Stefan Richter
Hi, You assumed correctly that savepoints are always self-contained. Are you using externalized checkpoints? There is a known problem in that was fixed in the latest master and will go into 1.3.2, but this might be a different problem. You are also correct that incremental checkpoints can refer

Re: FileNotFoundException when restoring checkpoint

2017-07-17 Thread Chesnay Schepler
Hello, If i recall correctly savepoints are always self-contained even if incremental checkpointing is enabled. However, this doesn't appear to be documented anywhere. As for the missing file, I'm looping in Stefan who is more knowledgeable about incremental checkpointing (and potentially kno

FileNotFoundException when restoring checkpoint

2017-07-17 Thread Shai Kaplan
Hi. I'm running Flink 1.3.1 with checkpoints stored in Azure blobs. Incremental checkpoints feature is on. The job is trying to restore a checkpoint and consistently gets: java.lang.IllegalStateException: Could not initialize keyed state backend. at org.apache.flink.streaming.api.operato