Re: (Co)ProcessFunction vs Keyed(Co)ProcessFunction

Hi Salva, I suppose what you are missing is that, the timers are stored in the keyed state, so you may only register timers when using KeyedCoProcessFunction. If you try to register a timer in the CoProcessFunction, you'll get an UnsupportedOperationException with the message "Setting timers is on

Re: flink-kubernetes-operator: image entrypoint misbehaves due to inability to write

Ah, got it. Thanks! On Thu, Dec 1, 2022 at 11:34 AM Gyula Fóra wrote: > As I also mentioned in the email, this is on our roadmap for the operator > but we have not implemented it yet because this feature only became > available as of Flink 1.16. > > Ideally in the operator FlinkDeployment spec.

How to use the local repositories Jar instead of pulling remote snapshots when building modules？

Hi, team. Maven always pulls remote decency snapshot jar When I build the Flink Kubernetes module. I also modified the Kubernetes module and the Flink client module that Kubernetes depends on. I hope to rely on my local repositories instead of remote snapshots when executing the build or runnin

Re: flink-kubernetes-operator: image entrypoint misbehaves due to inability to write

As I also mentioned in the email, this is on our roadmap for the operator but we have not implemented it yet because this feature only became available as of Flink 1.16. Ideally in the operator FlinkDeployment spec.flinkConfiguration section the user should be able to use env vars if this is added

Re: flink-kubernetes-operator: image entrypoint misbehaves due to inability to write

> Andrew please see my previous response, that covers the secrets case. > kubernetes.jobmanager.entrypoint.args: -D datadog.secret.conf=$MY_SECRET_ENV This way^? Ya that makes sense. It'd be nice if there was a way to get Secrets into the values used for rendering flink-conf.yaml too, so the con

Re: flink-kubernetes-operator: image entrypoint misbehaves due to inability to write

Andrew please see my previous response, that covers the secrets case. Gyula On Thu, Dec 1, 2022 at 2:54 PM Andrew Otto wrote: > > several failures to write into $FLINK_HOME/conf/. > I'm working on > > buildi

Re: flink-kubernetes-operator: image entrypoint misbehaves due to inability to write

> several failures to write into $FLINK_HOME/conf/. I'm working on building Flink and flink-kubernetes-operator images for the Wikimedia Foundation, and I found this strange as well. It makes sense in a docker

(Co)ProcessFunction vs Keyed(Co)ProcessFunction

The current docs claim [1]: "KeyedProcessFunction, as an extension of ProcessFunction, gives access to the key of timers in its onTimer(...) method." So, from what it's worth, it seems that if one does not need to query the current key, wich within a `Keyed(Co)ProcessFunction` can be done like th

Re: Difference between DataStream.broadcast() vs DataStream.broadcast(MapStateDescriptor)

Datastream.broadcast only determines the distribution behavior. All elements from the stream will broadcast to all the downstream tasks. Its downstream can be a single input processing operator, or a co-processing operator if it's connected to another stream. DataStream.broadcast(MapStateDescripto