Re: Programmatically Creating a Flink Cluster On YARN

2016-08-17 Thread Maximilian Michels
Hi Benjamin, Please apologize the late reply. In the latest code base and also Flink 1.1.1, the Flink configuration doesn't have to be loaded via a file location read from an environment variable and it doesn't throw an exception if it can't find the config upfront (phew). Instead, you can also se

Re: Programmatically Creating a Flink Cluster On YARN

2016-08-03 Thread Ufuk Celebi
What you describe seems to be correct and I am not aware of a "recommended approach". It's currently not well supported to programmatically create Flink on YARN clusters (like providing a YarnExecutionEnvironment or so). I think that Stephan and Max (cc'd) are coordinating some work, which should

Programmatically Creating a Flink Cluster On YARN

2016-08-02 Thread Bostow, Ben
I’m currently trying to programmatically create a Flink cluster on a given YARN cluster. I’m using the FlinkYarnClientBase class to do this currently with some limitations (Flink version 1.0.3). I’m wanting to pass in my own YARN configuration so that I can deploy Flink on different YARN cluste