Questions about implementing a flink source

Hello, I’m new to Flink. I’m trying to write a source for Pub/Sub Lite which is a partition based Pub/Sub product, and I have a few questions. 1. I saw that there are two sets of interfaces used in existing sources: The RichSourceFunction, and the set of interfaces from FLIP-27. It seems like the

Use State query to dump state into datalake

Hi, I am interested in dumping Flink state from Rockdb to datalake using state query https://ci.apache.org/projects/flink/flink-docs-master/docs/dev/datastream/fault-tolerance/queryable_state/. My map state could have 200 million key-values pairs and the total size could be 150G bytes. My batch jo

Re: Best practice for packaging and deploying Flink jobs on K8S

Thanks for updating the documentation Dian. Appreciate it. ..Sumeet On Sun, May 2, 2021 at 10:53 AM Dian Fu wrote: > Hi Sumeet, > > FYI: the documentation about the CLI options of PyFlink has already been > updated [1]. > > [1] > https://ci.apache.org/projects/flink/flink-docs-release-1.12/depl

Re: StopWithSavepoint() method doesn't work in Java based flink native k8s operator

Hello, I noticed that first trigger a savepoint and then delete the deployment might cause the duplicate data issue. That could pose a bad influence to the semantic correctness. Please give me some hints on how to make the stopWithSavepoint() work correctly with Fabric8io Java k8s client to per