钟洋洋 created FLINK-23930:
---------------------------
Summary: can not open web ui
Key: FLINK-23930
URL: https://issues.apache.org/jira/browse/FLINK-23930
Project: Flink
Issue Type: Technical Debt
Components: Deployment / Kubernetes
Affects Versions: 1.12.3
Environment: *this is my k8s job yaml*
apiVersion: batch/v1
kind: Job
metadata:
labels:
cattle.io/creator: norman
name: otsp
namespace: otsp-yd03-flink
spec:
backoffLimit: 6
completions: 1
parallelism: 1
selector:
matchLabels:
job-name: otsp
template:
metadata:
labels:
job-name: otsp
spec:
serviceAccount: otsp-flink-sa
containers:
- args:
- -c
- /opt/flink/bin/kubernetes-session.sh
-Dkubernetes.cluster-id=flink-native-k8s-session-2
-Dkubernetes.container.image=acpimagehub.cgb.cn/otsp_dev/flink-s3:1.12.3.10
-Djobmanager.heap.size=4096m
-Dtaskmanager.memory.process.size=4096m -Dtaskmanager.numberOfTaskSlots=16
-Dkubernetes.jobmanager.cpu=4
-Dkubernetes.taskmanager.cpu=16
-Dkubernetes.namespace=otsp-yd03-flink
-Dkubernetes.jobmanager.service-account=otsp-flink-sa
-Dkubernetes.rest-service.exposed.type=ClusterIP
-Dmetrics.reporter.promgateway.class=org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter
-Dmetrics.reporter.promgateway.host=21.96.246.38
-Dmetrics.reporter.promgateway.port=9091
-Dmetrics.reporter.promgateway.jobName=myJob
-Dmetrics.reporter.promgateway.randomJobNameSuffix=true
-Dmetrics.reporter.promgateway.deleteOnShutdown=false
-Dhigh-availability=ZOOKEEPER
-Dhigh-availability.zookeeper.quorum=21.96.18.110:2181
-Dhigh-availability.zookeeper.path.root=/flink
-Dhigh-availability.storageDir=s3//21.96.18.197:8082/flink
-Ds3.access-key=ABCDEFGHIJKLMNOPQRST
-Ds3.secret-key=abcdefghijklmnopqrstuvwxyz0123456789ABCD
-Ds3.endpoint=http://21.96.18.197:8082/
-Ds3.path.style.access=true
command:
- /bin/sh
image: acpimagehub.cgb.cn/otsp_dev/flink-s3:1.12.3.10
imagePullPolicy: Always
name: otsp
resources:
limits:
cpu: "8"
memory: 8000Mi
requests:
cpu: "1"
memory: 1000Mi
volumeMounts:
- name: log
mountPath: /opt/flink/log
subPath: otsp/flink
volumes:
- name: log
persistentVolumeClaim:
claimName: otsp-yd03-flink-pvcvof
dnsPolicy: ClusterFirst
restartPolicy: Never
*this is my k8s job startup log*
2021-08-24 02:03:27,393 INFO org.apache.flink.configuration.GlobalConfiguration
[] - Loading configuration property: jobmanager.rpc.address, localhost
2021-08-24 02:03:27,399 INFO org.apache.flink.configuration.GlobalConfiguration
[] - Loading configuration property: jobmanager.rpc.port, 6123
2021-08-24 02:03:27,399 INFO org.apache.flink.configuration.GlobalConfiguration
[] - Loading configuration property: jobmanager.memory.process.size, 1600m
2021-08-24 02:03:27,399 INFO org.apache.flink.configuration.GlobalConfiguration
[] - Loading configuration property: taskmanager.memory.process.size, 1728m
2021-08-24 02:03:27,399 INFO org.apache.flink.configuration.GlobalConfiguration
[] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2021-08-24 02:03:27,400 INFO org.apache.flink.configuration.GlobalConfiguration
[] - Loading configuration property: parallelism.default, 1
2021-08-24 02:03:27,400 INFO org.apache.flink.configuration.GlobalConfiguration
[] - Loading configuration property: jobmanager.execution.failover-strategy,
region
2021-08-24 02:03:28,560 INFO
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived
from fraction jvm overhead memory (160.000mb (167772162 bytes)) is less than
its min value 192.000mb (201326592 bytes), min value will be used instead
2021-08-24 02:03:28,811 INFO org.apache.flink.kubernetes.utils.KubernetesUtils
[] - Kubernetes deployment requires a fixed port. Configuration
blob.server.port will be set to 6124
2021-08-24 02:03:28,811 INFO org.apache.flink.kubernetes.utils.KubernetesUtils
[] - Kubernetes deployment requires a fixed port. Configuration
taskmanager.rpc.port will be set to 6122
2021-08-24 02:03:28,822 INFO org.apache.flink.kubernetes.utils.KubernetesUtils
[] - Kubernetes deployment requires a fixed port. Configuration
high-availability.jobmanager.port will be set to 6123
2021-08-24 02:03:28,887 INFO
org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived
from fraction jvm overhead memory (160.000mb (167772162 bytes)) is less than
its min value 192.000mb (201326592 bytes), min value will be used instead
2021-08-24 02:03:29,789 WARN
org.apache.flink.kubernetes.KubernetesClusterDescriptor [] - Please note that
Flink client operations(e.g. cancel, list, stop, savepoint, etc.) won't work
from outside the Kubernetes cluster since
'kubernetes.rest-service.exposed.type' has been set to ClusterIP.
2021-08-24 02:03:30,102 INFO
org.apache.flink.kubernetes.KubernetesClusterDescriptor [] - Create flink
session cluster flink-native-k8s-session-2 successfully, JobManager Web
Interface: http://flink-native-k8s-session-2-rest.otsp-yd03-flink:8081
2021-08-24 02:03:30,132 WARN
org.apache.flink.kubernetes.KubernetesClusterDescriptor [] - Please note that
Flink client operations(e.g. cancel, list, stop, savepoint, etc.) won't work
from outside the Kubernetes cluster since
'kubernetes.rest-service.exposed.type' has been set to ClusterIP.
*this is my jobmanager startup log*
sed: couldn't open temporary file /opt/flink/conf/sed2hgN96: Read-only file
system
sed: couldn't open temporary file /opt/flink/conf/sed7xkuf5: Read-only file
system
/docker-entrypoint.sh: line 75: /opt/flink/conf/flink-conf.yaml: Read-only file
system
sed: couldn't open temporary file /opt/flink/conf/sedKf9N2b: Read-only file
system
/docker-entrypoint.sh: line 90: /opt/flink/conf/flink-conf.yaml.tmp: Read-only
file system
Start command: $JAVA_HOME/bin/java -classpath $FLINK_CLASSPATH -Xmx1073741824
-Xms1073741824 -XX:MaxMetaspaceSize=268435456
-Dlog.file=/opt/flink/log/jobmanager.log
-Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
-Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
-Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
org.apache.flink.kubernetes.entrypoint.KubernetesSessionClusterEntrypoint -D
jobmanager.memory.off-heap.size=134217728b -D
jobmanager.memory.jvm-overhead.min=201326592b -D
jobmanager.memory.jvm-metaspace.size=268435456b -D
jobmanager.memory.heap.size=1073741824b -D
jobmanager.memory.jvm-overhead.max=201326592b
2021-08-24 02:03:38,955 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2021-08-24 02:03:38,960 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
KubernetesSessionClusterEntrypoint (Version: 1.12.3, Scala: 2.12, Rev:eae8bb1,
Date:2021-04-23T11:49:05+02:00)
2021-08-24 02:03:38,961 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user:
flink
2021-08-24 02:03:39,241 WARN org.apache.hadoop.util.NativeCodeLoader [] -
Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable
2021-08-24 02:03:39,302 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current
Hadoop/Kerberos user: flink
2021-08-24 02:03:39,302 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit
Server VM - Oracle Corporation - 1.8/25.292-b10
2021-08-24 02:03:39,302 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size:
989 MiBytes
2021-08-24 02:03:39,302 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME:
/usr/local/openjdk-8
2021-08-24 02:03:39,304 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 2.8.3
2021-08-24 02:03:39,304 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
2021-08-24 02:03:39,304 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1073741824
2021-08-24 02:03:39,304 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1073741824
2021-08-24 02:03:39,304 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:MaxMetaspaceSize=268435456
2021-08-24 02:03:39,304 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog.file=/opt/flink/log/jobmanager.log
2021-08-24 02:03:39,304 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
2021-08-24 02:03:39,305 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
2021-08-24 02:03:39,305 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
2021-08-24 02:03:39,305 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments:
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.off-heap.size=134217728b
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-overhead.min=201326592b
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-metaspace.size=268435456b
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.heap.size=1073741824b
2021-08-24 02:03:39,306 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2021-08-24 02:03:39,307 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-overhead.max=201326592b
2021-08-24 02:03:39,307 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath:
/opt/flink/lib/flink-csv-1.12.3.jar:/opt/flink/lib/flink-json-1.12.3.jar:/opt/flink/lib/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-table-blink_2.12-1.12.3.jar:/opt/flink/lib/flink-table_2.12-1.12.3.jar:/opt/flink/lib/log4j-1.2-api-2.12.1.jar:/opt/flink/lib/log4j-api-2.12.1.jar:/opt/flink/lib/log4j-core-2.12.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.12.1.jar:/opt/flink/lib/flink-dist_2.12-1.12.3.jar:::
2021-08-24 02:03:39,307 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2021-08-24 02:03:39,308 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX
signal handlers for [TERM, HUP, INT]
2021-08-24 02:03:39,320 INFO org.apache.flink.configuration.GlobalConfiguration
Reporter: 钟洋洋
*I created a k8s job to deploy Flink natively on Kubernetes. But I did not
deploy successfully and did not see the error log*
*When I remove the Ha configuration, I can successfully deploy and open the
webui*
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
