Shuiqiang Chen created FLINK-29146: -------------------------------------- Summary: User set job configuration can not be retirieved from JobGraph and ExecutionGraph Key: FLINK-29146 URL: https://issues.apache.org/jira/browse/FLINK-29146 Project: Flink Issue Type: Bug Reporter: Shuiqiang Chen
Currently, when building an ExecutionGraph, it requires to set the job specific information (like job id, job name, job configuration, etc) and most of them are from JobGraph.But I find that the configuraiton in JobGraph is a new Configuration instance that does not contain any user set configuration. As a result, we are not able retrieve the use specified job configuration in ExecutionGraph built from JobGraph during runtime execution. BTW, in StreamExecutionEnvironment, it seems that job configuraitons that not contained in built-in options will be igored when calling StreamExecutionEnvironment.configure(ReadableConfig[, ClassLoader]). However, it will be included when constructing a StreamExecutionEnvironment, which seems a bit inconsistent. {code:java} Configuration configuration = new Configuration(); // These configured string will take effect. configuration.setString("k1", "v1"); configuration.setString("k2", "v2"); configuration.setString("k3", "v3"); configuration.set(HeartbeatManagerOptions.HEARTBEAT_TIMEOUT, 300000L); final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(configuration); // These configured string will be ignored. configuration.setString("k4", "v4"); configuration.setString("k5", "v5"); configuration.setString("k6", "v6"); env.configure(configuration); {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)