RE: [DISCUSS] FLIP-288:Enable Dynamic Partition Discovery by Default in Kafka Source

2023-04-27 Thread Raman Verma
, where this call does not return before checkpoint. Thanks, Raman Verma On 2023/03/17 10:41:40 Hongshun Wang wrote: > Hi everyone, > > I would like to start a discussion on FLIP-288:Enable Dynamic Partition > Discovery by Default in Kafka Source[1]. > > As described in mail

RE: Re: [DISCUSS] FLIP-287: Extend Sink#InitContext to expose ExecutionConfig and JobID

2023-05-01 Thread Raman Verma
Hello Joao Boto, Can you please add Gordon’s suggested approach as a third option. Also, it will be great to list the pros and cons of each approach in the FLIP Thanks, Raman Verma On 2023/04/24 11:04:26 João Boto wrote: > Hi @Gordon, > > `InitContext#createInputSerializer()` i

Re: [DISCUSS] FLIP-278: Hybrid Source Connector

2023-05-22 Thread Raman Verma
Hello Ran Tao, Thanks for this FLIP. I have a comment about the handover of switching context between sources. You have proposed to define interfaces named around timestamps, SupportsGetEndTimestamp and SupportsSwitchedStartTimestamp. These work well with KafkaSource as the downstream child sour