Dear All, Recently, the Flink community starts to improve the yarn cluster descriptor to make job jar and config files configurable from CLI. It improves the flexibility of Flink deployment Yarn Per Job Mode. For platform users who manage tens of hundreds of streaming pipelines for the whole org or company, we found the job graph generation in client-side is another pinpoint. Thus, we want to propose a configurable feature for FlinkYarnSessionCli. The feature can allow users to choose the job graph generation in Flink ClusterEntryPoint so that the job jar doesn't need to be locally for the job graph generation. The proposal is organized as a FLIP https://cwiki.apache.org/confluence/display/FLINK/FLIP-85+Delayed+JobGraph+Generation .
Any questions and suggestions are welcomed. Thank you in advance. Best Regards Peter Huang