Hello Jeff, I have a Flink Session Cluster running on AKS Kubernetes. I'm trying to deploy zeppelin, so it allows me to connect to my existing Flink Job Manager and I can submit SQL jobs straight from zeppelin UI.
To give you more context, this is what I have on Kubernetes, There is a Flink's Job Manager which is running on POD1 and Task Manager is running on POD2. I want to install Zeppelin through YAML (https://github.com/apache/zeppelin/blob/master/k8s/zeppelin-server.yaml) on POD 3. As suggested earlier, I also downloaded flink 1.11.3 binaries and downloaded on Zeppelin server on K8s and configured the FLINK_HOME to point to that flink directory. In addition to the flink path, I also these properties set on flink interpreter- flink.execution.mode = remote flink.execution.remote.host = flink-jobmanager-rest flink.execution.remote.port = 8081 https://user-images.githubusercontent.com/16950114/104391793-afaa2a80-550e-11eb-8417-f676b5a7e02c.png https://user-images.githubusercontent.com/16950114/104391884-e4b67d00-550e-11eb-8f79-5b087c664c87.png https://user-images.githubusercontent.com/16950114/104392539-46c3b200-5510-11eb-95be-104117ff8fe9.png When I try to submit any jobs from Zeppelin, it causes a new Flink POD to create and it then deletes it self. Not sure what could be causing that. Also, As per this YAML https://github.com/apache/zeppelin/blob/master/k8s/zeppelin-server.yaml Is there a different image for interpreter apache/zeppelin-interpreter:0.9.0-SNAPSHOT (as mentioned in above YAML) or can I just use apache/zeppelin:0.9.0 image from https://hub.docker.com/r/apache/zeppelin/tags for ZEPPELIN_K8S_CONTAINER_IMAGE in the above zeppelin yaml? If I set the zeppelin.run.mode to local, will it still submits Jobs to the flink-jobmanager-rest host? Please let me know how can I make that work? Thanks, Amit
