Re: CheckpointedFunction initialization during checkpoint

2020-10-03 Thread Yun Tang
.java#L496 Best Yun Tang From: Aljoscha Krettek Sent: Tuesday, September 29, 2020 20:51 To: dev@flink.apache.org Subject: Re: CheckpointedFunction initialization during checkpoint Hi Teng, I think if the system is slowed down enough it can happen that some parts of

Re: CheckpointedFunction initialization during checkpoint

2020-09-29 Thread Aljoscha Krettek
Hi Teng, I think if the system is slowed down enough it can happen that some parts of the graph are still restoring while others are already taking a checkpoint. By virtue of how checkpointing works (by sending barriers along the network connections between tasks) this should not be a problem

CheckpointedFunction initialization during checkpoint

2020-09-28 Thread Teng Fei Liao
Hey all, I've been trying to debug a job recovery performance issue and I'm noticing some interesting events in the timeline that seem unexpected to me. Here's a brief outline of the first checkpoint following a job restart: 1. All tasks are deployed and transition into the RUNNING state. 2. I se