Re: Managing Flink on Yarn programmatically

2016-05-17 Thread Robert Metzger
Hi, There is currently no officially supported API for managing Flink on YARN programatically. I think the ideal solution would be something like a YarnExecutionEnvironment. But you can still do it, by using Flink's internal YARN abstraction. Check out this YARN test case, that is programmaticall

Managing Flink on Yarn programmatically

2016-05-16 Thread John Sherwood
I think this is primarily a shortcoming in my ability to grep through Scala efficiently, but are there any resources on how to programmatically spin up & administrate Flink jobs on YARN? The CLI naturally works, but I'd like to build out a service handling the nuances of job management rather than