Shuiqiang Chen created FLINK-29146:
--------------------------------------

             Summary: User set job configuration can not be retirieved from 
JobGraph and ExecutionGraph
                 Key: FLINK-29146
                 URL: https://issues.apache.org/jira/browse/FLINK-29146
             Project: Flink
          Issue Type: Bug
            Reporter: Shuiqiang Chen


Currently, when building an ExecutionGraph, it requires to set the job specific 
information (like job id, job name, job configuration, etc) and most of them 
are from JobGraph.But I find that the configuraiton in JobGraph is a new 
Configuration instance that does not contain any user set configuration. As a 
result, we are not able retrieve the use specified job configuration in 
ExecutionGraph built from JobGraph during runtime execution.

BTW, in StreamExecutionEnvironment, it seems that job configuraitons that not 
contained in built-in options will be igored when calling 
StreamExecutionEnvironment.configure(ReadableConfig[, ClassLoader]). However, 
it will be included when constructing a StreamExecutionEnvironment, which seems 
a bit inconsistent.

{code:java}
Configuration configuration = new Configuration();
// These configured string will take effect.
configuration.setString("k1", "v1");
configuration.setString("k2", "v2");
configuration.setString("k3", "v3");
configuration.set(HeartbeatManagerOptions.HEARTBEAT_TIMEOUT, 300000L);
final StreamExecutionEnvironment env = 
StreamExecutionEnvironment.getExecutionEnvironment(configuration);

// These configured string will be ignored.
configuration.setString("k4", "v4");
configuration.setString("k5", "v5");
configuration.setString("k6", "v6");
env.configure(configuration);
{code}




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to