Re: Flink Interpreter w/ yarn-session

2016-04-21 Thread Andrea Sella
Hi Till, It works as expected, thanks! Andrea 2016-04-19 15:25 GMT+02:00 Till Rohrmann : > Hi Andrea, > > I think your problem should be fixed with the PRs [1,2]. I've tested it > locally on my yarn cluster and it worked. > > [1] https://github.com/apache/flink/pull/1904 > [2] https://github.co

Re: Flink Interpreter w/ yarn-session

2016-04-19 Thread Till Rohrmann
Hi Andrea, I think your problem should be fixed with the PRs [1,2]. I've tested it locally on my yarn cluster and it worked. [1] https://github.com/apache/flink/pull/1904 [2] https://github.com/apache/flink/pull/1914 Cheers, Till On Tue, Apr 19, 2016 at 2:16 PM, Till Rohrmann wrote: > I think

Re: Flink Interpreter w/ yarn-session

2016-04-15 Thread Till Rohrmann
In HA mode, the host and port information you provide to the Shell should be simply ignored. So you don't have to retrieve them from the .yarn-properties file. Could you maybe run the FlinkInterpreter with debug log level and share the logs with me? You can also do that privately, if you don't wan

Re: Flink Interpreter w/ yarn-session

2016-04-14 Thread Andrea Sella
Hi Till, The cluster has started in HA. I already patched Flink interpreter to allow passing the Configuration to FlinkILoop. Neverthless I have to pass host and port to FlinkILoop, there are required from FlinkILoop constructor and I retrieve them from .yarn-properties file. I logged Flink Confi

Re: Flink Interpreter w/ yarn-session

2016-04-14 Thread Till Rohrmann
Hi Andrea, have you started the Flink Yarn cluster in HA mode? Then the job manager address is stored in ZooKeeper and you have to tell your FlinkILoop that it should retrieve the JobManager address from there. In order to do that you have to set conf.setString(ConfigConstants.RECOVERY_MODE, "zook

Flink Interpreter w/ yarn-session

2016-04-12 Thread Andrea Sella
Hi, I am working to allow Zeppelin's flink interpreter to connect an existing yarn cluster. Yarn cluster has started via yarn-session and flink's version is 1.0.0. My approach is to read host and port from .yarn-properties and pass them to IFlinkLoop. Now I am facing an issue with Session ID when