Re: Setting operator parallelism of a running job - Flink 1.2

2017-04-21 Thread Aljoscha Krettek
Hi, both savepoints and checkpoints use the configured state backend. Right now, the only difference between a checkpoint and a savepoint is that the savepoint has additional meta data stored with it that makes it persistent and relocatable. In the future, the (on-disk) format of savepoints and

Re: Setting operator parallelism of a running job - Flink 1.2

2017-04-21 Thread Dominik Safaric
Hi Aljoscha, In other words, jobs must be restarted manually? What about using maxParallelism() at the client level? I would expect that it is complementary to parallelism.default in terms of allowing Flink to handle the parallelism of operators, and changing it in accordance to runtime condi

Re: Setting operator parallelism of a running job - Flink 1.2

2017-04-21 Thread Aljoscha Krettek
Hi, changing the parallelism is not possible while a job is running (currently). What you would have to do to change the parallelism is create a savepoint and then restore from that savepoint with a different parallelism. This is the savepoints documentation: https://ci.apache.org/projects/flin