Re: Flink long-running YARN configuration

2016-08-30 Thread Maximilian Michels
Yes, it will exist also in the Yarn session and continue to run across jobs. Its address is also printed on the console when the cluster is brought up. On Mon, Aug 29, 2016 at 2:44 PM, Robert Metzger wrote: > The JobManager UI starts when running Flink on YARN. > The address of the UI is register

Re: Flink long-running YARN configuration

2016-08-29 Thread Robert Metzger
The JobManager UI starts when running Flink on YARN. The address of the UI is registered at YARN, so you can also access it through YARNs command line tools or its web interface. On Fri, Aug 26, 2016 at 7:28 PM, Trevor Grant wrote: > Stephan, > > Will the jobmanager-UI exist? E.g. if I am runni

Re: Flink long-running YARN configuration

2016-08-26 Thread Trevor Grant
Stephan, Will the jobmanager-UI exist? E.g. if I am running Flink on YARN will I be able to submit apps/see logs and DAGs through the web interface? thanks, tg Trevor Grant Data Scientist https://github.com/rawkintrevo http://stackexchange.com/users/3002022/rawkintrevo http://trevorgrant.org

Re: Flink long-running YARN configuration

2016-08-25 Thread Stephan Ewen
Hi Craig! For YARN sessions, Flink will - (a) register the app master hostname/port/etc at Yarn, so you can get them from example from the yarn UI and tools - (b) it will create a .yarn-properties file that contain the hostname/ports info. Future calls to the command line pick up the info from

Flink long-running YARN configuration

2016-08-25 Thread Foster, Craig
I'm trying to understand Flink YARN configuration. The flink-conf.yaml file is supposedly the way to configure Flink, except when you launch Flink using YARN since that's determined for the AM. The following is contradictory or not completely clear: "The system will use the configuration in co