Re: How to submit flink job on yarn by java code

2018-08-16 Thread Piotr Nowojski
Hi, Is this path accessible on the container? If not, use some distributed file system, nfs or -yt —yarnship option of the cli. Please also take a look at https://lists.apache.org/thread.html/%3CCAF=1nJ8GONoqux7czxpUxAf7L3p=-E_ePSTHk0uWa=GRyG=2...@mail.gmail.com%3E

Re: How to submit flink job on yarn by java code

2018-08-16 Thread spoon_lz
Sorry, I don't know why the code and error are not visible. The error is : The program finished with the following exception: /org.apache.flink.client.deployment.ClusterDeploymentException: Could not deploy Yarn job cluster. at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(

Re: How to submit flink job on yarn by java code

2018-08-15 Thread Rong Rong
I dont think your exception / code was attached. In general, this is largely depending on how your setup is. Are you trying to setup a long-running YARN session cluster or are you trying to directly use YARN cluster submit? [1]. We have an open-sourced project [2] with similar requirement submitti

How to submit flink job on yarn by java code

2018-08-14 Thread spoon_lz
My project is to automatically generate flink's code jar and then submit it to yarn cluster for execution and get the ApplicationId. I find that after execution, an error will be reported Then I searched for the error on Google and found that the reason for the error was that I did not introduce