Re: Very slow recovery from Savepoint

2021-02-05 Thread Robert Metzger
Great to hear that you were able to resolve the issue! On Thu, Feb 4, 2021 at 5:12 PM Yordan Pavlov wrote: > Thank you for your tips Robert, > I think I narrowed down the problem to having slow Hard disks. Once > the memory runs out, RocksDb starts spilling to the disk and the > performance degr

Re: Very slow recovery from Savepoint

2021-02-02 Thread Robert Metzger
Hey Yordan, have you checked the log files from the processes in that cluster? The JobManager log should give you hints about issues with the coordination / scheduling of the job. Could it be something unexpected, like your job could not start, because there were not enough TaskManagers available?

Very slow recovery from Savepoint

2021-01-28 Thread Yordan Pavlov
Hello there, I am trying to find the solution for a problem we are having in our Flink setup related to very slow recovery from a Savepoint. I have searched in the mailing list, found a somewhat similar problem, the bottleneck there was the HD usage, but I am not seeing this in our case. Here is a