Re: Post-processing batch JobExecutionResult

2019-09-06 Thread Zili Chen
Attach the missing link. [1] https://docs.google.com/document/d/1E-8UjOLz4QPUTxetGWbU23OlsIH9VIdodpTsxwoQTs0/edit#heading=h.s8r4pkyalskt [2] https://lists.apache.org/x/thread.html/ce99cba4a10b9dc40eb729d39910f315ae41d80ec74f09a356c73938@ Zili Chen 于2019年9月7日周六 上午12:52写道: > Besides, if you subm

Re: Post-processing batch JobExecutionResult

2019-09-06 Thread Zili Chen
Besides, if you submit the job by Jar Run REST API, it is also OptimizerPlanEnvironment to be used. So again, _no_ post processing support at the moment. Zili Chen 于2019年9月7日周六 上午12:51写道: > Hi spoganshev, > > If you deploy in per-job mode, OptimizerPlanEnvironment would be used, and > thus > as

Re: Post-processing batch JobExecutionResult

2019-09-06 Thread Zili Chen
Hi spoganshev, If you deploy in per-job mode, OptimizerPlanEnvironment would be used, and thus as you pointed out, there is _no_ way to post processing JobExecutionResult. We the community regard this situation as a shortcoming and work on an enhancement progress to enable you get a JobClient as r

Re: Post-processing batch JobExecutionResult

2019-09-06 Thread Zhu Zhu
Hi spoganshev, The *OptimizerPlanEnvironment* is for creating optimized plan only, as described in the javadoc "An {@link ExecutionEnvironment} that never executes a job but only creates the optimized plan." It execute() is invoked with some internal handling so that it only generates optimized pl

Post-processing batch JobExecutionResult

2019-09-06 Thread spoganshev
Due to OptimizerPlanEnvironment.execute() throwing exception on the last line there is not way to post-process batch job execution result, like: JobExecutionResult r = env.execute(); // execute batch job analyzeResult(r); // this will never get executed due to plan optimization https://github.com