Re: Apache Flink - Using upsert JDBC sink for DataStream

Hi, If you need JDBC upsert functionality, it's easier to implement app using Flink SQL. You could use JDBC Table Connector [1]. You could define primary key in DDL when writing data to external database. See CREATE TABLE DDL

Re: Catching SIGINT With flink Jobs

Hi, Would you please describe your demand in more detail? Do you want to release resource when the job is closing? If yes, you could overwrite the close() method of the custom source and custom sink. Best, JING ZHANG Caizhi Weng 于2021年10月18日周一 上午10:27写道： > Hi! > > This is generally "how to capt

Re: Programmatically configuring S3 settings

Hi, Pavel. >From my understanding of the doc[1], you need to set it in flink-conf.yaml instead of your job. [1] https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/filesystems/s3/#hadooppresto-s3-file-systems-plugins Best, Yangze Guo On Sat, Oct 16, 2021 at 5:46 AM Pavel Pen

Re: Display time in UTC on the UI

Hi! Append -Duser.timezone=UTC to env.java.opts.jobmanager and env.java.opts.taskmanager. These two configurations are the Java options to start JVM of the jobmanager / taskmanager (see [1]). Note that this essentially changes the time zone of the whole JVM. So if you have any time zone related o

Re: Catching SIGINT With flink Jobs

Hi! This is generally "how to capture SIGINT in Java". See [1] for the answer. By the way, can you briefly explain why you want to do this in your custom source and sink? [1] https://stackoverflow.com/questions/2541475/capture-sigint-in-java Vijay Bhaskar 于2021年10月16日周六 下午10:54写道： > Can we re

Re: dataStream can not use multiple classloaders

Hi! There is only one classloader for user code by default in runtime. The main method of your code is only executed on the client side. It generates a job graph and sends it to the cluster. To avoid class loading conflict it is recommended to shade the dependencies of your source and sink functi

EKs FlinkK8sOperator for 1.20

hi ,    I was planning to install Flink using k8sOperator for EKS version 1.20GitHub - GoogleCloudPlatform/flink-on-k8s-operator: Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications. | | | | | | | | | | | GitHub - GoogleCloudPlatform/flink-on-k8s-oper