[ https://issues.apache.org/jira/browse/FLINK-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ruidong Li updated FLINK-12406: ------------------------------- Description: After each job finishes, the new {{BLOCKING_PERSISTENT}} result partitions are generated, and locations of these result partitions should be report back to client via {{JobExecutionResult}}, they will be later used for Table {{cache()}} and {{invalidateCache()}} Brief Changes: - Add a new class {{IntermediateResultDescriptor}}, which stores location of a {{BLOCKING_PERSISTENT}} {{ResultPartition}}, currently we only support {{ResultPartition}} in {{TaskManager}}. - Add a new method {{getResultPartitionDescriptors()}} in {{AccessExecutionGraph}} - Add a new filed in {{JobExecutionResult}}, {{JobResult}}, {{ArchivedExecutionGraph}} and {{ExecutionEnvironment}}, which keeps a mapping from {{IntermediateDataSetID}} to its {{ResultPartition}} locations - When a job finishes, the metadata will flow in this path: {{ExecutionGraph}} -> {{ArchivedExecutionGraph}} -> {{JobExecutionResult}} -> {{JobResult}} -> {{ExecutionEnvironment}} was:After each job finishes, the new {{BLOCKING_PERSISTENT}} result partitions are generated, and locations of these result partitions should be report back to client via {{JobExecutionResult}}, they will be later used for Table {{cache()}} and {{invalidateCache()}} > Report BLOCKING_PERSISTENT result partition meta back to client > --------------------------------------------------------------- > > Key: FLINK-12406 > URL: https://issues.apache.org/jira/browse/FLINK-12406 > Project: Flink > Issue Type: Sub-task > Components: API / DataSet, Runtime / Coordination > Reporter: Ruidong Li > Assignee: Ruidong Li > Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > After each job finishes, the new {{BLOCKING_PERSISTENT}} result partitions > are generated, and locations of these result partitions should be report back > to client via {{JobExecutionResult}}, they will be later used for Table > {{cache()}} and {{invalidateCache()}} > > Brief Changes: > - Add a new class {{IntermediateResultDescriptor}}, which stores location of > a {{BLOCKING_PERSISTENT}} {{ResultPartition}}, currently we only support > {{ResultPartition}} in {{TaskManager}}. > - Add a new method {{getResultPartitionDescriptors()}} in > {{AccessExecutionGraph}} > - Add a new filed in {{JobExecutionResult}}, {{JobResult}}, > {{ArchivedExecutionGraph}} and {{ExecutionEnvironment}}, which keeps a > mapping from {{IntermediateDataSetID}} to its {{ResultPartition}} locations > - When a job finishes, the metadata will flow in this path: > {{ExecutionGraph}} -> {{ArchivedExecutionGraph}} -> {{JobExecutionResult}} -> > {{JobResult}} -> {{ExecutionEnvironment}} -- This message was sent by Atlassian JIRA (v7.6.3#76005)