Re: [DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2022-12-29 Thread Zhu Zhu
Hi Junrui, Thanks for creating this FLIP! AdaptiveBatchScheduler is more powerful than DefaultScheduler in batch scheduling, also with some must-have features like speculative execution. It will be great that users can easily use it, without required to knowing the underlying scheduler and config

Re: [DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2022-12-29 Thread yuxia
Hi, JunRui Lee. Thanks for driving this FLIP. It must a good improvement for batch users' experiences. I have few questions about this FLIP: 1: About the configuration renaming. The old configurations will be deprecated or removed directly? if user upgrade their Flink version, these old configu

Re: [DISCUSS] Extending the feature freezing date of Flink 1.17

2022-12-29 Thread Leonard Xu
Thanks Qingsheng for the proposal, the pandemic has really impacted development schedules. Jan 31st makes sense to me. Best, Leonard

[DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2022-12-29 Thread JunRui Lee
Hi, devs, I'd like to start a discussion about FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs[1]. In FLIP-187, we introduced an adaptive batch scheduler. The adaptive batch scheduler has stronger batch scheduling capabilities, including automatically deciding paralleli

Re: [DISCUSS] FLIP-282: Introduce Delete & Update API

2022-12-29 Thread yuxia
Hi, Lincoln Lee; 1: Yes, it's a typo; Thanks for pointing out. I have fixed the typo. 2: For stream users, assuming for delete, they will receive TableException("DELETE TABLE is not supported for streaming mode now"); Update is similar. I also update them to the FLIP. Best regards, Yuxia

Re: [DISCUSS] FLIP-274 : Introduce metric group for OperatorCoordinator

2022-12-29 Thread Jark Wu
Hi Hang, Thanks for driving this discussion. I think this is a very useful feature for connectors. The FLIP looks quite good to me, and I just have two suggestions. 1. In the "Public Interface" section, mention that the implementation behavior of "SplitEnumeratorContext#metricGroup" is changed f

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-29 Thread Yuxin Tan
Hi, everyone Thanks for the reply and the discussion. We discussed this with @Guowei Ma, @Dong Lin, and @Yanfei Lei offline, and reached a consensus on this FLIP. Based on the offline discussions and suggestions from @Weihua Hu, the following changes have been updated in the FLIP. 1. Changes in

[jira] [Created] (FLINK-30534) Discuss / migrate People section to Hugo

2022-12-29 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-30534: -- Summary: Discuss / migrate People section to Hugo Key: FLINK-30534 URL: https://issues.apache.org/jira/browse/FLINK-30534 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-30533) IteratorSourceReaderBase#pollNext() should push records to ReaderOutput in a while loop

2022-12-29 Thread Dong Lin (Jira)
Dong Lin created FLINK-30533: Summary: IteratorSourceReaderBase#pollNext() should push records to ReaderOutput in a while loop Key: FLINK-30533 URL: https://issues.apache.org/jira/browse/FLINK-30533 Proje