Zhilong Hong created FLINK-21330:
------------------------------------
Summary: Optimization the initialization of
PipelinedRegionSchedulingStrategy
Key: FLINK-21330
URL: https://issues.apache.org/jira/browse/FLINK-21330
Project: Flink
Issue Type: Sub-task
Components: Runtime / Coordination
Reporter: Zhilong Hong
Fix For: 1.13.0
{{PipelinedRegionSchedulingStrategy}} is used for task scheduling. Its
initialization is located at {{PipelinedRegionSchedulingStrategy#init}}. The
initialization can be divided into two parts:
# Calculating consumed result partitions of SchedulingPipelinedRegions
# Calculating the consumer pipelined region of SchedulingResultPartition
Based on FLINK-21328, the {{consumedResults}} of
{{DefaultSchedulingPipelinedRegion}} can be replaced with
{{ConsumedPartitionGroup}}.
Then we can optimize the procedures we mentioned above. After the optimization,
the time complexity decreases from O(N^2) to O(N).
The related usage of {{getConsumedResults}} should be replaced, too.
The detailed design doc is located at:
[https://docs.google.com/document/d/1OjGAyJ9Z6KsxcMtBHr6vbbrwP9xye7CdCtrLvf8dFYw/edit#heading=h.a1mz4yjpry6m]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
