Kurt Young created FLINK-4430:
---------------------------------

             Summary: prevent BLOCKING partition data lose when task is finished
                 Key: FLINK-4430
                 URL: https://issues.apache.org/jira/browse/FLINK-4430
             Project: Flink
          Issue Type: Sub-task
            Reporter: Kurt Young


When we have a BLOCKING result partition type, the data is actually holded by 
TaskManager, not the slot. When we finish the produce task, we will mark this 
task finished and try to release the slot. Under the new architecture, with 
yarn or mesos mode, releasing slot may trigger releasing the container, so the 
TaskManager will be terminated, thus the result data is lost. We should 
introduce some mechanism to prevent this from happening.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to