Hi Till,
Could u tell me how to configure HDFS as statebackend when I deploy flink on
k8s?
I try to add the following to flink-conf.yaml
state.backend: rocksdb
state.checkpoints.dir: hdfs://slave2:8020/flink/checkpoints
state.savepoints.dir: hdfs://slave2:8020/flink/savepoints
state.backend.incr
The scheme is not
directly supported by Flink and no Hadoop file system to support this scheme
could be loaded. For a full list of supported file systems, please
seehttps://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/.
| |
superainbower
|
|
superainbo...@163.com
|
签名由网易邮箱大师
state.backend.incremental: true
| |
superainbower
|
|
superainbo...@163.com
|
签名由网易邮箱大师定制
Hi Till & Yang,
I can deploy Flink on kubernetes(not minikube), it works well
So there are some problem about my minikube but I can’t find and fix it
Anyway I can deploy on k8s now
Thanks for your help!
| |
superainbower
|
|
superainbo...@163.com
|
签名由网易邮箱大师定制
On 09/3/2020 15:47，Till Rohr
component: taskmanager
spec:
containers:
- name: taskmanager
image: registry.cn-hangzhou.aliyuncs.com/superainbower/flink:1.11.1
args: ["taskmanager","-Djobmanager.rpc.address=172.18.0.5"]
ports:
- containerPort: 6122
ger ,there is no response
| |
superainbower
|
|
superainbo...@163.com
|
签名由网易邮箱大师定制
On 09/3/2020 09:03，superainbower wrote：
Hi Till,
This is the taskManager log
As you see, the logs print ‘line 92 -- Could not connect to
flink-jobmanager:6123’
then print ‘line 128 --Could not resolve ResourceMa
/superainbower/flink:1.11.1
args: ["jobmanager"]
ports:
- containerPort: 6123
name: rpc
- containerPort: 6124
name: blob-server
- containerPort: 8081
name: webui
livenessProbe:
tcpSocket:
