Dear All,

Recently, the Flink community starts to improve the yarn cluster descriptor
to make job jar and config files configurable from CLI. It improves the
flexibility of  Flink deployment Yarn Per Job Mode. For platform users who
manage tens of hundreds of streaming pipelines for the whole org or
company, we found the job graph generation in client-side is another
pinpoint. Thus, we want to propose a configurable feature for
FlinkYarnSessionCli. The feature can allow users to choose the job graph
generation in Flink ClusterEntryPoint so that the job jar doesn't need to
be locally for the job graph generation. The proposal is organized as a
FLIP
https://cwiki.apache.org/confluence/display/FLINK/FLIP-85+Delayed+JobGraph+Generation
.

Any questions and suggestions are welcomed. Thank you in advance.


Best Regards
Peter Huang

Reply via email to