Re: Running a flink job with Yarn per-job mode from application code.

2021-12-09 Thread Caizhi Weng
Hi! For Yarn jobs, Flink web UI (which shares the same port with REST API) can be found by clicking into the "Application Manager" link in the corresponding application page. I'm not familiar with Yarn API but I guess there is some way to get this application manager link. Kamil ty 于2021年12月9日周四

Re: Running a flink job with Yarn per-job mode from application code.

2021-12-09 Thread Kamil ty
Sorry for that. Will remember to add the mailing list in responses. The REST API approach will probably be sufficient. One more question regarding this. Is it possible to get the address/port of the rest api endpoint from the job? I see that when deploying a job to yarn the rest.address and rest.p

Re: Running a flink job with Yarn per-job mode from application code.

2021-12-08 Thread Caizhi Weng
Hi! Please make sure to always reply to the user mailing list so that everyone can see the discussion. You can't get the execution environment for an already running job but if you want to operate on that job you can try to get its JobClient instead. However this is somewhat complicated to get wi

Re: Running a flink job with Yarn per-job mode from application code.

2021-12-07 Thread Caizhi Weng
Hi! So you would like to submit a yarn job with Java code, not using /bin/flink run? If that is the case, you'll need to set 'execution.target' config option to 'yarn-per-job'. Set this in the configuration of ExecutionEnvironment and execute the job with Flink API as normal. Kamil ty 于2021年12月

Running a flink job with Yarn per-job mode from application code.

2021-12-07 Thread Kamil ty
Hello all, I'm looking for a way to submit a Yarn job from another flink jobs application code. I can see that you can access a cluster and submit jobs with a RestClusterClient, but it seems a Yarn per-job mode is not supported with it. Any suggestions would be appreciated. Best Regards Kamil