Kurt Young created FLINK-4430: --------------------------------- Summary: prevent BLOCKING partition data lose when task is finished Key: FLINK-4430 URL: https://issues.apache.org/jira/browse/FLINK-4430 Project: Flink Issue Type: Sub-task Reporter: Kurt Young
When we have a BLOCKING result partition type, the data is actually holded by TaskManager, not the slot. When we finish the produce task, we will mark this task finished and try to release the slot. Under the new architecture, with yarn or mesos mode, releasing slot may trigger releasing the container, so the TaskManager will be terminated, thus the result data is lost. We should introduce some mechanism to prevent this from happening. -- This message was sent by Atlassian JIRA (v6.3.4#6332)