Great to hear that you were able to resolve the issue!
On Thu, Feb 4, 2021 at 5:12 PM Yordan Pavlov wrote:
> Thank you for your tips Robert,
> I think I narrowed down the problem to having slow Hard disks. Once
> the memory runs out, RocksDb starts spilling to the disk and the
> performance degr
Hey Yordan,
have you checked the log files from the processes in that cluster?
The JobManager log should give you hints about issues with the coordination
/ scheduling of the job. Could it be something unexpected, like your job
could not start, because there were not enough TaskManagers available?
