Re: flink checkpoint state data corruption

2019-11-14 Thread Yun Tang
: Yu Li Date: Friday, November 15, 2019 at 1:29 AM To: dev , Yun Tang Subject: Re: flink checkpoint state data corruption @Yun Tang<mailto:myas...@live.com> As the author of the referenced PR, it would be great if you could help take a look here. Thanks. @Jeffery: For your second question

Re: flink checkpoint state data corruption

2019-11-14 Thread Yu Li
@Yun Tang As the author of the referenced PR, it would be great if you could help take a look here. Thanks. @Jeffery: For your second question, with officially released Flink, once checkpoint has been completed successfully it's safe to restore from [1]. The issue you encountered probably was cau

flink checkpoint state data corruption

2019-11-13 Thread Jeffrey Martin
Hi all, I'm using protobufs as keys of a Flink stream using code copied from this pull request , but deserialization is failing after checkpoint restore due to missing data. I'm using HDFS and the RocksDB backend. I tried providing the path to a previous