Till Rohrmann created FLINK-3346:
------------------------------------
Summary: Replace Akka death watch with own heartbeats
Key: FLINK-3346
URL: https://issues.apache.org/jira/browse/FLINK-3346
Project: Flink
Issue Type: Improvement
Components: Distributed Runtime
Affects Versions: 1.0.0
Reporter: Till Rohrmann
Priority: Minor
Currently, we're using Akka's death watch to detect failed instances (e.g. the
JM watches the TM and vice versa). Whenever a death watch is triggered, the
corresponding {{ActorSystem}} is quarantined. This will prevent the quarantined
{{ActorSystem}} from reconnecting to the detecting system, in case that it
didn't die. This can happen once in a while given a sub-optimal death watch
configuration.
In order to prevent this from happening, we could implement our own heartbeats
which are periodically sent from the {{TaskManagers}} to the {{JobManager}} and
vice versa, for example. Not receiving a certain number of heartbeats could
then mean that the {{TaskManager}} is marked as dead.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)