What to do about local disks with RocksDB with Kubernetes Operator

2023-10-18 Thread Alex Craig
The recommended practice for RocksDB usage is to have local disks accessible to it. The Kubernetes Operator doesn’t have fields related to creating disks for RocksDB to use. For instance, say I have maxParallelism=10 but parallelism=1. I have a statically created PVC named “flink-rocksdb”. The

Kubernetes HA having issues when restarting job

2023-10-13 Thread Alex Craig
My job in Kubernetes periodically fails with the following error: 2023-10-13 18:22:32,153 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint[] - Fatal error occurred in the cluster entrypoint. java.util.concurrent.CompletionException: org.apache.flink.util.FlinkRuntimeException

Issues using savepoint upgradeMode with Kubernetes Operator

2023-10-04 Thread Alex Craig
Hello, For one, excellent work on the K8s Operator, which works extremely well. However, I am having an issue that I can't seem to resolve where setting the upgradeMode to savepoint simply doesn't work. For example, suppose I submit a job using FlinkDeployment like so: job: entryClass: "org.a