Re: Migration to application mode

2022-08-02 Thread Tamas Kiss
Thanks Lijie/Biao To put it simply, what we like to achieve is to replace env.runAsync() with some code that uses application mode. @Lijie: When I set deployment mode to application I got the following exception after submitting the job Caused by: java.lang.IllegalStateException: No ExecutorFact

Re: Migration to application mode

2022-08-01 Thread Biao Geng
Hi there, Currently, YARN Application mode only supports running a jar job. And as Lijie said, the main method is executed on JM, so if I understand correctly, your previous way of running execute() method on client side to submit a job to YARN cluster may not work. A quick workaround is to create

Re: Migration to application mode

2022-08-01 Thread Lijie Wang
Hi, I think the difference between ApplicationMode and PerJob is just where the main method is executed (ApplicationMode executes on JM, PerJob executes on client side). So I think your original job code should work well under ApplicationMode. Did you encounter any problems? You can get more detail