Yang, It worked finally... after adding kubernetes related config in
configmap.
On Thu, Jan 21, 2021 at 7:13 PM Yang Wang wrote:
> You could set config option "kubernetes.namespace" to your flink-conf
> ConfigMap. And then
> KubernetesHAService will use it to create/watch the ConfigMap. Please n
You could set config option "kubernetes.namespace" to your flink-conf
ConfigMap. And then
KubernetesHAService will use it to create/watch the ConfigMap. Please note
the default service
account has enough permission.
Of course, you could also set the config option
"kubernetes.service-account" to an
It works now. Job manager is able to start. But now, I have run into
another issue.
It seems job manager is trying to create configmap in default namespace and
namespace/service account where I run job manager does not have access to
configmap
GET at:
https://X.X.X.X/api/v1/namespaces/default/con
You do not need to put flink-kubernetes_2.12-1.12.1.jar under the plugin
directory. Only the S3 fs jar
needs to be put there.
I think I found the root cause. It seems your flink-dist is still 1.11.
Do you want to use the image 1.11 and enable the K8s HA at the same time?
I think it could not work.
I did move to 1.12.1 version and also ensured that docker has kubernetes
jar file in the right location, i.e.
/opt/flink/plugins/s3-fs-presto/flink-kubernetes_2.12-1.12.1.jar
But job manager is still not able to find the class
2021-01-21 00:00:49,376 ERROR
org.apache.flink.runtime.entrypoint.Clus
Class
"org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory"
is introduced from 1.12.0 version.
You could try with the latest version 1.12.1[1].
Will that jar file need to be copied under /opt/flink/plugins/s3-fs-presto
> folder?
Yes, you need to copy the s3 fs implementation
Hi,
I am not able to identify maven artifact that will have implementation for
this class
org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
I am using info in this link to test out HA implementation
https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/ha
