Hi,
I am working to allow Zeppelin's flink interpreter to connect an existing
yarn cluster. Yarn cluster has started via yarn-session and flink's version
is 1.0.0.
My approach is to read host and port from .yarn-properties and pass them to
IFlinkLoop.
Now I am facing an issue with Session ID when I submit a paragraph to yarn
cluster.
The yarn cluster throws a warning similar to:
2016-04-12 10:14:32,666 WARN org.apache.flink.yarn.YarnJobManager
- Discard message
LeaderSessionMessage(null,SubmitJob(JobGraph(jobId:
0b6811bc58d781ddb6f5aac994afd903),EXECUTION_RESULT_AND_STATE_CHANGES))
because the expected leader session ID
Some(afc85978-f765-488b-acbb-79c2d7cb89e0) did not equal the received
leader session ID None.
My Zeppelin's paragraph throws a JobClientActorSubmissionTimeoutException,
maybe is it due to the missing sessionId? Do I need to pass extra params to
connect correctly to the yarn cluster or host and port are enough?
Thanks in advance,
Andrea
