Re: need flink support framework for dependency injection

> *= false > > > */** Opens the respective function/operator for initialization of state > primitives */ *def open(rtc: RuntimeContext): Unit = { > *boundedMode *= > rtc match { > case src: StreamingRuntimeContext => > src.getTaskManagerRuntim

Re: need flink support framework for dependency injection

Hi Thias, Could you share your approach to job setup using Spring, if that's possible? We also use Spring Boot for DI in jobs, primarily relying on profiles. I'm particularly interested in how you use the same job structures for different scenarios, such as reading savepoints. Thank you very much.

[Flink Kubernetes Operator] Restoring from an outdated savepoint.

I wanted to talk about an issue we've hit recently with Flink Kubernetes Operator 1.6.1 and Flink 1.17.1. As we're using the Savepoint upgrade mode, we ran into cases where the lastSavepoint in status doesn't seem to update (still digging into why, could be an exception when cancelling tasks?).Thi

Re: Class not found exception for loaded class

guration/advanced/#hadoop-dependencies > for how to make them available. > > Best regards, > > Martijn > > On Mon, Apr 17, 2023 at 2:04 PM Ruibin Xing wrote: > >> Hi community, >> >> I was testing Flink 1.17 on Kubernetes and ran

Class not found exception for loaded class

Hi community, I was testing Flink 1.17 on Kubernetes and ran into a strange class loading problem. In short, the logs show org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback was loaded, however the program will throw ClassNotFoundException anyway. The exception was thrown by Aliyun

Re: Elasticsearch Connector 1.17 not on maven central.

g/flink/flink-docs-release-1.17/docs/connectors/datastream/elasticsearch/. > I have created an issue https://issues.apache.org/jira/browse/FLINK-31801 > > Best, > Shammon FY > > On Thu, Apr 13, 2023 at 6:40 PM Ruibin Xing wrote: > >> Hi community, >> >> W

Elasticsearch Connector 1.17 not on maven central.

Hi community, When following the instructions for importing es connector into my project on https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/elasticsearch/, maven can't find the required version: > > org.apache.flink > flink-connector-elasticsearch7 > 3.0.0-

Seeking Advice on Minimizing Downtime During Application Logic Upgrades in Flink Cluster

Hi Community, I need some advice on upgrading the application logic in our Apache Flink cluster without causing any downtime. We're using Flink for our most important data pipeline, and we need to keep upgrading the application logic to meet our business needs. However, we're worried about the dow

How does Flink plugin system work?

Hi community, I am having difficulty understanding the Flink plugin system. I am attempting to enable the Prometheus exporter with the official Flink image 1.16.0, but I am experiencing issues with library dependencies. According to the plugin documentation ( https://nightlies.apache.org/flink/fli

Deploy Flink on YARN or Kubernetes.

Hi all, We are currently setting up a new Flink cluster and are trying to decide on the best deployment method. As far as we know, Flink supports two resource providers: YARN and Kubernetes. We are having difficulty evaluating the pros and cons of each provider, particularly in terms of stability,

K8S operator support status

Hi community, I'm looking into the Flink K8s operator documents, and I'm a bit confused about the following: 1. The latest document ( https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/concepts/overview/) says that Kubernetes standalone mode is not supported

Implement watermark buffering with Process Function

Hi, I'm trying to implement customized state logic with KeyedProcessFunction. But I'm not quite sure how to implement the correct watermark behavior when late data is involved. According to the answer on stackoverflow: https://stackoverflow.com/questions/59468154/how-to-sort-an-out-of-order-event