Re: [DISCUSS] FLIP-394: Add Metrics for Connector Agnostic Autoscaling

2023-11-18 Thread Leonard Xu
Thanks Mason for starting this thread discussion, generally +1 for the motivation and proposal . I have some questions about the detail after read the FLIP. 1. The FLIP says "However, pendingRecords is currently only reported by the SourceReader and doesn’t cover the case for sources that onl

Re: [DISCUSS] FLIP-383: Support Job Recovery for Batch Jobs

2023-11-18 Thread Guowei Ma
Hi, This is a very good proposal, as far as I know, it can solve some very critical production operations in certain scenarios. I have two minor issues: As far as I know, there are multiple job managers on standby in some scenarios. In this case, is your design still effective? I'm unsure if you

Re: Proposal for Implementing Keyed Watermarks in Apache Flink

2023-11-18 Thread Tawfek Yasser Tawfek
Hello Alexander, Will we continue the discussion? Thanks & BR, Tawfik From: Tawfek Yasser Tawfek Sent: 30 October 2023 15:32 To: dev@flink.apache.org Subject: Re: Proposal for Implementing Keyed Watermarks in Apache Flink Hi Alexander, Thank you for your r

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-18 Thread Junrui Lee
Hello Wencong, Thank you for your valuable feedback and suggestions. I want to clarify that reviewing existing methods in the ExecutionConfig is not directly related to the proposal in this FLIP. The main focus of this FLIP is to deprecate the specific method RuntimeContext#getExecutionConfig(). I