RE: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Keyed State Snapshot Binary Format for Savepoints Thanks for the inputs Yu and Aljoscha! I agree to rename this FLIP. Will call it "Unified binary format for Keyed State". I will proceed to open a VOTE thread to formally adopt the FLIP now. On Fri, Jun 14, 2019 at 10:03 PM Aljosc

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Thanks for the inputs Yu and Aljoscha! I agree to rename this FLIP. Will call it "Unified binary format for Keyed State". I will proceed to open a VOTE thread to formally adopt the FLIP now. On Fri, Jun 14, 2019 at 10:03 PM Aljoscha Krettek wrote: > Please also see my comment on > https://issu

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Please also see my comment on https://issues.apache.org/jira/browse/FLINK-12619?focusedCommentId=16864098&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16864098

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Hi Aljoscha and all, My 2 cents here: 1. Conceptually it worth a second thought about introducing an optimized snapshot format for now (i.e. use checkpoint format in savepoint), just like it's not recommended to use snapshot for backup in database (although practically it could be implemented).

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Btw, I think this FLIP is a very good effort, we just need to reframe the effort a tiny bit. +1 > On 6. Jun 2019, at 13:41, Aljoscha Krettek wrote: > > Hi, > > I had a brief discussion with Stephan that helped me sort my thoughts on the > broader topics of checkpoints, savepoints, binary form

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Hi, I had a brief discussion with Stephan that helped me sort my thoughts on the broader topics of checkpoints, savepoints, binary formats, user-triggered checkpoints, and periodic savepoints. I’ll try to summarise my stance on this and also comment with the same message on the other relevant J

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

I want to quickly bump this discussion to gather more consensus from others on the FLIP, and see if we want to aim this for the upcoming 1.9.0 release. The proposal touches binary formats of savepoints, which is a major part of Flink's public user interface, so having explicit approval from other m

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

I also should point out something that I forgot to mention in the initial post: Stefan has helped a lot in understanding the current status of state backends and also participated a lot in design choices for the FLIP :) On Wed, May 29, 2019 at 5:02 AM Tzu-Li (Gordon) Tai wrote: > Hi Flink devs,

Re: [DISCUSS] FLIP-41: Unify Keyed State Snapshot Binary Format for Savepoints

Hi Gordon Thanks for the nice work. Big +1 for this. With the proposal, we’ll have unified binary format for savepoints, so users can switch backend using savepoint if they needed. And Users will be able to seamlessly migrate from previous savepoints of older Flink versions as the wiki said. B