Re: Question about start with checkpoint.

2017-05-21 Thread SHI Xiaogang
Hi Yunfan, Jobs are supposed to correctly restart from both savepoints and checkpoints with different parallelisms if only operator states and keyed states are used. In the cases where there exist unpartitionable states (e.g., those are produced by the Checkpointed interface), the job will fail to

Re: Question about start with checkpoint.

2017-05-21 Thread yunfan123
I using 1.2.0 release, so I read the document in https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/savepoints.html. It means it can recover from the savepoint even if I change the parallelism. How does flink implement it? For example using rocksdb+hdfs as state backend, flink just

Re: Question about start with checkpoint.

2017-05-20 Thread Kostas Kloudas
Hi, In order to change parallelism, you should take a savepoint, as described here: https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/savepoints.html Kostas > On May 21, 2017, at 5:43 AM, yunfa