Re: Flink on Yarn - ApplicationMaster command

2016-04-25 Thread Maximilian Michels
Great to hear! :) On Sun, Apr 24, 2016 at 3:51 PM, Theofilos Kakantousis wrote: > Hi, > > The issue was a mismatch of jar versions on my client. Seems to be working > fine now. > Thanks again for your help! > > Cheers, > Theofilos > > > On 2016-04-22 18:22, Theofilos Kakantousis wrote: > > Hi Max

Re: Flink on Yarn - ApplicationMaster command

2016-04-24 Thread Theofilos Kakantousis
Hi, The issue was a mismatch of jar versions on my client. Seems to be working fine now. Thanks again for your help! Cheers, Theofilos On 2016-04-22 18:22, Theofilos Kakantousis wrote: Hi Max, I manage to get the jobManagerAddress from FlinkYarnCluster, however when I submit a job using t

Re: Flink on Yarn - ApplicationMaster command

2016-04-22 Thread Theofilos Kakantousis
Hi Max, I manage to get the jobManagerAddress from FlinkYarnCluster, however when I submit a job using the code below the jobID is null. Is there something wrong in the way I submit the job? Otherwise any ideas to which direction should I further investigate? The /runBlocking /call returns al

Re: Flink on Yarn - ApplicationMaster command

2016-04-22 Thread Maximilian Michels
Hi Theofilos, Assuming you have the FlinkYarnCluster after the call to deploy(). You can get the JobManager address using the InetSocketAddress address = cluster.getJobManagerAddress(); Then create a Configuration with this address: Configuration config = new Configuration(); config.setString(C

Re: Flink on Yarn - ApplicationMaster command

2016-04-19 Thread Theofilos Kakantousis
Hi Max, Thank you for your reply. Exactly, I want to setup the Yarn cluster and submit a job through code and not using cmd client. I had done what you suggested, I used part of the deploy method to write my own code that starts up the cluster which seems to be working fine. Could you point m

Re: Flink on Yarn - ApplicationMaster command

2016-04-19 Thread Maximilian Michels
Hi Theofilos, I'm not sure whether I understand correctly what you are trying to do. I'm assuming you don't want to use the command-line client. You can setup the Yarn cluster in your code manually using the FlinkYarnClient class. The deploy() method will give you a FlinkYarnCluster which you can

Flink on Yarn - ApplicationMaster command

2016-04-19 Thread Theofilos Kakantousis
Hi everyone, I'm using Flink 0.10.1 and hadoop 2.4.0 to implement a client that submits a flink application to Yarn. To keep it simple I use the ConnectedComponents app from flink examples. I set the required properties (Resources, AM ContainerLaunchContext etc.) on the YARN client interface