Re: New KafkaSource API: Change in default behavior regarding starting offset

2022-06-18 Thread liangzai
请问这个邮件咋退订? Replied Message | From | bastien dine | | Date | 06/15/2022 17:50 | | To | Martijn Visser | | Cc | Jing Ge, user | | Subject | Re: New KafkaSource API : Change in default behavior regarding starting offset | Hello Martijn, Thanks for the link to the release note, especia

Re: Flink, JSON, and JSONSchemas

2022-06-18 Thread Andrew Otto
> > *1. Is there some easy way to use deserialized JSON in DataStream without case classes or POJOs?* > Could you explain what you expected? Do you mean you want to just register a DataType that is able to bridge the received bytes to the POJO objects. No, heh, I don't want to have any POJO objects

Re: Metrics for FileSource

2022-06-18 Thread Jing Ge
Hi Meghajit, Thanks for the feedback. I have fired a ticket: https://issues.apache.org/jira/browse/FLINK-28117 Best regards, Jing On Mon, Jun 13, 2022 at 7:23 AM Meghajit Mazumdar < meghajit.mazum...@gojek.com> wrote: > Hi folks, > > Thanks for the reply. > We have implemented our own SplitAssi

Savepoint (with job cancel) while checkpoint in progress

2022-06-18 Thread Sudharsan R
Hello, We are running a single job in a flink 1.11.1 cluster on a k8s cluster. We use zookeeper HA mode. To upgrade our application code, we do a flink cli job cancel with savepoint. We then bring down the whole flink cluster. We bring it back up and submit the new app code with this savepoint. H