钟洋洋 created FLINK-23930: --------------------------- Summary: can not open web ui Key: FLINK-23930 URL: https://issues.apache.org/jira/browse/FLINK-23930 Project: Flink Issue Type: Technical Debt Components: Deployment / Kubernetes Affects Versions: 1.12.3 Environment: *this is my k8s job yaml*
apiVersion: batch/v1 kind: Job metadata: labels: cattle.io/creator: norman name: otsp namespace: otsp-yd03-flink spec: backoffLimit: 6 completions: 1 parallelism: 1 selector: matchLabels: job-name: otsp template: metadata: labels: job-name: otsp spec: serviceAccount: otsp-flink-sa containers: - args: - -c - /opt/flink/bin/kubernetes-session.sh -Dkubernetes.cluster-id=flink-native-k8s-session-2 -Dkubernetes.container.image=acpimagehub.cgb.cn/otsp_dev/flink-s3:1.12.3.10 -Djobmanager.heap.size=4096m -Dtaskmanager.memory.process.size=4096m -Dtaskmanager.numberOfTaskSlots=16 -Dkubernetes.jobmanager.cpu=4 -Dkubernetes.taskmanager.cpu=16 -Dkubernetes.namespace=otsp-yd03-flink -Dkubernetes.jobmanager.service-account=otsp-flink-sa -Dkubernetes.rest-service.exposed.type=ClusterIP -Dmetrics.reporter.promgateway.class=org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter -Dmetrics.reporter.promgateway.host=21.96.246.38 -Dmetrics.reporter.promgateway.port=9091 -Dmetrics.reporter.promgateway.jobName=myJob -Dmetrics.reporter.promgateway.randomJobNameSuffix=true -Dmetrics.reporter.promgateway.deleteOnShutdown=false -Dhigh-availability=ZOOKEEPER -Dhigh-availability.zookeeper.quorum=21.96.18.110:2181 -Dhigh-availability.zookeeper.path.root=/flink -Dhigh-availability.storageDir=s3//21.96.18.197:8082/flink -Ds3.access-key=ABCDEFGHIJKLMNOPQRST -Ds3.secret-key=abcdefghijklmnopqrstuvwxyz0123456789ABCD -Ds3.endpoint=http://21.96.18.197:8082/ -Ds3.path.style.access=true command: - /bin/sh image: acpimagehub.cgb.cn/otsp_dev/flink-s3:1.12.3.10 imagePullPolicy: Always name: otsp resources: limits: cpu: "8" memory: 8000Mi requests: cpu: "1" memory: 1000Mi volumeMounts: - name: log mountPath: /opt/flink/log subPath: otsp/flink volumes: - name: log persistentVolumeClaim: claimName: otsp-yd03-flink-pvcvof dnsPolicy: ClusterFirst restartPolicy: Never *this is my k8s job startup log* 2021-08-24 02:03:27,393 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost 2021-08-24 02:03:27,399 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 2021-08-24 02:03:27,399 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m 2021-08-24 02:03:27,399 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m 2021-08-24 02:03:27,399 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2021-08-24 02:03:27,400 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1 2021-08-24 02:03:27,400 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region 2021-08-24 02:03:28,560 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction jvm overhead memory (160.000mb (167772162 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead 2021-08-24 02:03:28,811 INFO org.apache.flink.kubernetes.utils.KubernetesUtils [] - Kubernetes deployment requires a fixed port. Configuration blob.server.port will be set to 6124 2021-08-24 02:03:28,811 INFO org.apache.flink.kubernetes.utils.KubernetesUtils [] - Kubernetes deployment requires a fixed port. Configuration taskmanager.rpc.port will be set to 6122 2021-08-24 02:03:28,822 INFO org.apache.flink.kubernetes.utils.KubernetesUtils [] - Kubernetes deployment requires a fixed port. Configuration high-availability.jobmanager.port will be set to 6123 2021-08-24 02:03:28,887 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction jvm overhead memory (160.000mb (167772162 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead 2021-08-24 02:03:29,789 WARN org.apache.flink.kubernetes.KubernetesClusterDescriptor [] - Please note that Flink client operations(e.g. cancel, list, stop, savepoint, etc.) won't work from outside the Kubernetes cluster since 'kubernetes.rest-service.exposed.type' has been set to ClusterIP. 2021-08-24 02:03:30,102 INFO org.apache.flink.kubernetes.KubernetesClusterDescriptor [] - Create flink session cluster flink-native-k8s-session-2 successfully, JobManager Web Interface: http://flink-native-k8s-session-2-rest.otsp-yd03-flink:8081 2021-08-24 02:03:30,132 WARN org.apache.flink.kubernetes.KubernetesClusterDescriptor [] - Please note that Flink client operations(e.g. cancel, list, stop, savepoint, etc.) won't work from outside the Kubernetes cluster since 'kubernetes.rest-service.exposed.type' has been set to ClusterIP. *this is my jobmanager startup log* sed: couldn't open temporary file /opt/flink/conf/sed2hgN96: Read-only file system sed: couldn't open temporary file /opt/flink/conf/sed7xkuf5: Read-only file system /docker-entrypoint.sh: line 75: /opt/flink/conf/flink-conf.yaml: Read-only file system sed: couldn't open temporary file /opt/flink/conf/sedKf9N2b: Read-only file system /docker-entrypoint.sh: line 90: /opt/flink/conf/flink-conf.yaml.tmp: Read-only file system Start command: $JAVA_HOME/bin/java -classpath $FLINK_CLASSPATH -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456 -Dlog.file=/opt/flink/log/jobmanager.log -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties org.apache.flink.kubernetes.entrypoint.KubernetesSessionClusterEntrypoint -D jobmanager.memory.off-heap.size=134217728b -D jobmanager.memory.jvm-overhead.min=201326592b -D jobmanager.memory.jvm-metaspace.size=268435456b -D jobmanager.memory.heap.size=1073741824b -D jobmanager.memory.jvm-overhead.max=201326592b 2021-08-24 02:03:38,955 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2021-08-24 02:03:38,960 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesSessionClusterEntrypoint (Version: 1.12.3, Scala: 2.12, Rev:eae8bb1, Date:2021-04-23T11:49:05+02:00) 2021-08-24 02:03:38,961 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: flink 2021-08-24 02:03:39,241 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2021-08-24 02:03:39,302 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: flink 2021-08-24 02:03:39,302 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.292-b10 2021-08-24 02:03:39,302 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 989 MiBytes 2021-08-24 02:03:39,302 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /usr/local/openjdk-8 2021-08-24 02:03:39,304 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 2.8.3 2021-08-24 02:03:39,304 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options: 2021-08-24 02:03:39,304 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1073741824 2021-08-24 02:03:39,304 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1073741824 2021-08-24 02:03:39,304 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456 2021-08-24 02:03:39,304 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/flink/log/jobmanager.log 2021-08-24 02:03:39,304 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml 2021-08-24 02:03:39,305 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties 2021-08-24 02:03:39,305 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties 2021-08-24 02:03:39,305 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments: 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=1073741824b 2021-08-24 02:03:39,306 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-08-24 02:03:39,307 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b 2021-08-24 02:03:39,307 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink/lib/flink-csv-1.12.3.jar:/opt/flink/lib/flink-json-1.12.3.jar:/opt/flink/lib/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-table-blink_2.12-1.12.3.jar:/opt/flink/lib/flink-table_2.12-1.12.3.jar:/opt/flink/lib/log4j-1.2-api-2.12.1.jar:/opt/flink/lib/log4j-api-2.12.1.jar:/opt/flink/lib/log4j-core-2.12.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.12.1.jar:/opt/flink/lib/flink-dist_2.12-1.12.3.jar::: 2021-08-24 02:03:39,307 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2021-08-24 02:03:39,308 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT] 2021-08-24 02:03:39,320 INFO org.apache.flink.configuration.GlobalConfiguration Reporter: 钟洋洋 *I created a k8s job to deploy Flink natively on Kubernetes. But I did not deploy successfully and did not see the error log* *When I remove the Ha configuration, I can successfully deploy and open the webui* -- This message was sent by Atlassian Jira (v8.3.4#803005)