Re: Avoid dynamic classloading in native mode with Kubernetes Operator

2023-12-15 Thread Trystan
Is it better to create a Jira issue for this? From what I can tell it is currently not possible to use native k8s mode while having the jar in the system classpath. This seems like something that would generally be useful in order to avoid dynamic classloading when using the operator. On Mon, Nov

Scaling in stateful application

2023-12-15 Thread rania duni
Hello all! I have enabled flink Kubernetes operator's scaler and I have a stateful application. In the yaml file I have set the savepoint directory and the upgrade mode is *savepoint. *What configurations should be enabled to ensure a safe upgrade with savepoints during scaling operations?

multiple jobs in same deployment file

2023-12-15 Thread Shravan Kumar Reddy
Hi Team, How can we configure multiple task managers and multiple jobs with the same deployment file with flink operator. *Deployment.yaml* apiVersion: flink.apache.org/v1beta1 kind: FlinkDeployment metadata: name: basic-example spec: image: flink:1.17 flinkVersion: v1_17 flinkConfigurati

Re: Re:Re: Event stuck in the Flink operator

2023-12-15 Thread T, Yadhunath
Hi Xuyang, Thanks for the reply! I don't have any dataset to share with you at this time. The last block in the Flink pipeline performs 2 functions - temporal join( 2nd temporal join) and writing data into the sink topic. This is what Flink SQL code looks like - SELECT * FROM TABLE1 T1 LEFT

Re: Event stuck in the Flink operator

2023-12-15 Thread T, Yadhunath
Hi Alex, Thanks for the reply! I have 3 Flink SQL table which is joined using temporal join. I am using the timestamp field in the first table as the event time attribute. eg: SELECT * FROM TABLE1 T1 LEFT JOIN TABLE2 FOR SYSTEM_TIME AS OF T1.timestamp as T2 -- Temporal join ON *JOIN