Re: Taskmanager killed often after migrating to flink 1.12

2021-04-29 Thread Till Rohrmann
Great, thanks for the update. On Wed, Apr 28, 2021 at 7:08 PM Sambaran wrote: > Hi Till, > > Thank you for the response, we are currently running flink with an > increased memory usage, so far the taskmanager is working fine, we will > check if there is any further issue and will update you. > >

Re: Taskmanager killed often after migrating to flink 1.12

2021-04-28 Thread Sambaran
Hi Till, Thank you for the response, we are currently running flink with an increased memory usage, so far the taskmanager is working fine, we will check if there is any further issue and will update you. Regards Sambaran On Wed, Apr 28, 2021 at 5:33 PM Till Rohrmann wrote: > Hi Sambaran, > >

Re: Taskmanager killed often after migrating to flink 1.12

2021-04-28 Thread Till Rohrmann
Hi Sambaran, could you also share the cause why the checkpoints could not be discarded with us? With Flink 1.10, we introduced a stricter memory model for the TaskManagers. That could be a reason why you see more TaskManagers being killed by the underlying resource management system. You could ma

Taskmanager killed often after migrating to flink 1.12

2021-04-27 Thread Sambaran
Hi there, We have recently migrated to flink 1.12 from 1.7, although the jobs are running fine, sometimes the task manager is getting killed (much frequently 2-3 times a day). Logs: INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - RECEIVED SIGNAL 15: SIGTERM. Shutting down