Hi all, I'm have a failed job containing a BucketingSink. The last successful checkpoint was before the source started emitting data. The following checkpoints all failed due to the long timeout as I mentioned here : http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Checkpoints-very-slow-with-high-backpressure-td12762.html .
The Taskmanager has then failed. Upon recovery, the pending fies did not move to finished state. Is that because the sink was not able to checkpoint to list of pending files? Is it possible to build the sink state just from the output folder and the suffixes of the files? Thanks, Yassine