Re: [DISCUSS] Support Suspending and Resuming of Flink Jobs

2016-10-12 Thread Till Rohrmann
Hi Greg, at the moment the serialization of savepoints costs the same as the serialization of checkpoints, because they use the same serialization logic. In fact, with Ufuk's changes [1], a savepoint is a checkpoint with special properties. However, in the future we will probably have different se

Re: [DISCUSS] Support Suspending and Resuming of Flink Jobs

2016-10-12 Thread Greg Hogan
Sorry, I haven't followed this development, but roughly how much more costly is the new serialization for savepoints? On Wed, Oct 12, 2016 at 5:51 AM, SHI Xiaogang wrote: > Hi all, > > Currently, savepoints are exactly the completed checkpoints, and Flink > provides commands (save/run) to allow

[DISCUSS] Support Suspending and Resuming of Flink Jobs

2016-10-12 Thread SHI Xiaogang
Hi all, Currently, savepoints are exactly the completed checkpoints, and Flink provides commands (save/run) to allow saving and restoring jobs. But in the near future, savepoints will be very different from checkpoints because they will have common serialization formats and allow recover from majo