Re: What is the flink-kubernetes-operator webhook for?

2022-12-09 Thread Andrew Otto
Okay, thank you both. We will disable webhook creation unless we end up needing it. On Fri, Dec 9, 2022 at 9:39 AM Gyula Fóra wrote: > To add to what Matyas said: > > Validation in itself is a mandatory step for every spec change that is > submitted to guard against broken configs (things lik

Re: What is the flink-kubernetes-operator webhook for?

2022-12-09 Thread Gyula Fóra
To add to what Matyas said: Validation in itself is a mandatory step for every spec change that is submitted to guard against broken configs (things like negative parallelism etc). But validation can happen in 2 places. It can be done through the webhook, which would result in upfront rejection o

Re: What is the flink-kubernetes-operator webhook for?

2022-12-09 Thread Őrhidi Mátyás
Hi Otto, webhooks in general are optional components of the k8s operator pattern. Mostly used for validation, sometimes for changing custom resources and handling multiple versions, etc. It's an optional component in the Flink Kubernetes Operator too. Regards, Matyas On Fri, Dec 9, 2022 at 5:59

What is the flink-kubernetes-operator webhook for?

2022-12-09 Thread Andrew Otto
Hello! What is the Flink Kubernetes Webhook for? I probably don't know just because I don't know k8s that well, but reading code and other docs didn't particular enlighten me :)

Re: Could not restore keyed state backend for KeyedProcessOperator

2022-12-09 Thread Lars Skjærven
Lifecycle rulesNone On Fri, Dec 9, 2022 at 3:17 AM Hangxiang Yu wrote: > Hi, Lars. > Could you check whether you have configured the lifecycle of google cloud > storage[1] which is not recommended in the flink checkpoint usage? > > [1] https://cloud.google.com/storage/docs/lifecycle > > On Fri,

Re: ArgoCD unable to process health from k8s FlinkDeployment - stuck in Processing

2022-12-09 Thread Gyula Fóra
Hi! The resource lifecycle state is currently not shown explicitly in the status. You are confusing it with reconciliation status. At the moment you can only get this through the Java client: https://github.com/apache/flink-kubernetes-operator/blob/main/flink-kubernetes-operator-api/src/main/jav

ArgoCD unable to process health from k8s FlinkDeployment - stuck in Processing

2022-12-09 Thread Edgar H
Morning all, Recently been testing the Flink k8s operator (flink.apache.org/v1beta1) and although the jobs do startup and run perfectly fine, their status in ArgoCD is not yet as it should be, some details: When describing the flinkdeployment I'm currently trying to test, the follows appears in e

Re: ZLIB Vulnerability Exposure in Flink statebackend RocksDB

2022-12-09 Thread Martijn Visser
Hi Vidya, Please keep in mind that the Flink project is driven by volunteers. If you're noticing an outdated version for the lz4 compression library and an update is required, it would be great if you can open the PR to update that dependency yourself. Best regards, Martijn On Thu, Dec 8, 2022