Re:Window's Checkpoint problem

2016-11-28 Thread liuxinchun
Dear Aljoscha: I'm the colleague of 时某人,and participate in the design of Checkpoint mechanism of a certain Streaming Processing System, which refers to Flink's Checkpoint mechanism. In my opinion, the most difficulty in stream's checkpoint is big window's backup. In many applications, the win

Re:Window's Checkpoint problem

2016-11-25 Thread 时某人
Is there some State backend and checkpoint design architecture document? ChengXiang Li have some sharing about checkout on Hangzhou Flink Meetup. https://github.com/pusuo/streaming-resource/blob/master/flink-meetup-hz-20161105/Flink%E5%88%86%E5%B8%83%E5%BC%8F%E5%BF%AB%E7%85%A7%E6%B7%B1%E5%85%A5