[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhu Zhu updated FLINK-18295: ---------------------------- Comment: was deleted (was: This issue was labeled "stale-major" 7 ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. ) > Remove the hack logics of result consumers > ------------------------------------------ > > Key: FLINK-18295 > URL: https://issues.apache.org/jira/browse/FLINK-18295 > Project: Flink > Issue Type: Technical Debt > Components: Runtime / Coordination > Reporter: Zhu Zhu > Priority: Major > > Currently an {{IntermediateDataSet}} can have multiple {{JobVertex}} as its > consumers. That's why the consumers of a `IntermediateResultPartition` is in > the form of {{List<List<ExecutionEdge>>}}. > However, in scheduler/{{ExecutionGraph}} there is assumption that one > `IntermediateResultPartition` can be consumed by one only > `ExecutionJobVertex`. This results in a lot of hack logics which assumes > partition consumers to contain a single list. > We should remove these hack logics. The idea is to change > `IntermediateResultPartition#consumers` to be `List<ExecutionEdge>`. > `ExecutionGraph` building logics should be adjusted accordingly with the > assumption that an `IntermediateResult` can have one only consumer vertex. In > `JobGraph`, there should also be check logics for this assumption. -- This message was sent by Atlassian Jira (v8.3.4#803005)