More details on here - https://github.com/apache/zeppelin/pull/3356
On 2021/01/13 23:01:28, Amit Shahi <ami.onewo...@gmail.com> wrote: > Hello Jeff, > > I have a Flink Session Cluster running on AKS Kubernetes. > I'm trying to deploy zeppelin, so it allows me to connect to my existing > Flink Job Manager and I can submit SQL jobs straight from zeppelin UI. > > To give you more context, this is what I have on Kubernetes, There is a > Flink's Job Manager which is running on POD1 and Task Manager is running on > POD2. > I want to install Zeppelin through YAML > (https://github.com/apache/zeppelin/blob/master/k8s/zeppelin-server.yaml) on > POD 3. > > As suggested earlier, I also downloaded flink 1.11.3 binaries and downloaded > on Zeppelin server on K8s and configured the FLINK_HOME to point to that > flink directory. > In addition to the flink path, I also these properties set on flink > interpreter- > > flink.execution.mode = remote > flink.execution.remote.host = flink-jobmanager-rest > flink.execution.remote.port = 8081 > > https://user-images.githubusercontent.com/16950114/104391793-afaa2a80-550e-11eb-8417-f676b5a7e02c.png > > https://user-images.githubusercontent.com/16950114/104391884-e4b67d00-550e-11eb-8f79-5b087c664c87.png > > https://user-images.githubusercontent.com/16950114/104392539-46c3b200-5510-11eb-95be-104117ff8fe9.png > > When I try to submit any jobs from Zeppelin, it causes a new Flink POD to > create and it then deletes it self. > Not sure what could be causing that. > > Also, As per this YAML > https://github.com/apache/zeppelin/blob/master/k8s/zeppelin-server.yaml > > Is there a different image for interpreter > apache/zeppelin-interpreter:0.9.0-SNAPSHOT (as mentioned in above YAML) > or can I just use apache/zeppelin:0.9.0 image from > https://hub.docker.com/r/apache/zeppelin/tags > for ZEPPELIN_K8S_CONTAINER_IMAGE in the above zeppelin yaml? > > If I set the zeppelin.run.mode to local, will it still submits Jobs to the > flink-jobmanager-rest host? > > Please let me know how can I make that work? > > Thanks, > Amit >
