回复: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2023-09-27 Thread Chen Zhanghao
+1 (non-binding), thanks for driving this. Best, Zhanghao Chen 发件人: Shammon FY 发送时间: 2023年9月25日 13:28 收件人: dev 主题: [VOTE] FLIP-314: Support Customized Job Lineage Listener Hi devs, Thanks for all the feedback on FLIP-314: Support Customized Job Lineage Listener

回复: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-25 Thread Chen Zhanghao
d you like to add explicit description about any potential(or none) compatibility issues if users want to use this new feature and start existing jobs with savepoints or checkpoints? Best regards, Jing On Sun, Sep 24, 2023 at 9:05 PM Chen Zhanghao wrote: > Hi Lincoln, > > Thanks for the

回复: [VOTE] FLIP-362: Support minimum resource limitation

2023-09-25 Thread Chen Zhanghao
Thanks for driving this. +1 (non-binding) Best, Zhanghao Chen 发件人: xiangyu feng 发送时间: 2023年9月25日 17:38 收件人: dev@flink.apache.org 主题: [VOTE] FLIP-362: Support minimum resource limitation Hi all, I would like to start the vote for FLIP-362: Support minimum resou

回复: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-24 Thread Chen Zhanghao
2jzv0c9o3clwqskpllnw8rh87 [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-291%3A+Externalized+Declarative+Resource+Management [3] https://issues.apache.org/jira/browse/FLINK-31471 Best, Lincoln Lee Chen Zhanghao 于2023年9月22日周五 16:00写道: > Thanks to everyone who participated in the

[RESULT][VOTE] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-22 Thread Chen Zhanghao
Hi everyone, The proposal, FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI, has been unanimously accepted with 5 votes (4 binding): +1 votes: - Yangze Guo (binding) - Rui Fan (binding) - Jing Ge (binding) - Weihua Hu (binding) - Matt Wang Thanks again to

回复: [VOTE] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-22 Thread Chen Zhanghao
, Sep 19, 2023 at 6:16 PM Jing Ge wrote: +1(binding) Thanks! Best regards, Jing On Tue, Sep 19, 2023 at 9:01 AM Chen Zhanghao wrote: Hi Devs, Thanks for all the feedbacks on FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI [1][2]. Given that the consensus on the

回复: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

2023-09-22 Thread Chen Zhanghao
Hi Junrui, Thanks for driving this, +1 for it Best, Zhanghao Chen 发件人: Junrui Lee 发送时间: 2023年9月20日 11:06 收件人: dev@flink.apache.org 主题: [Discuss] FLIP-366: Support standard YAML for FLINK configuration Hi devs, I would like to start a discussion about FLIP-366:

回复: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-22 Thread Chen Zhanghao
FLIP-367: Support Setting Parallelism for Table/SQL Sources Hi Zhanghao, Thanks for the update; +1 for the proposal! Best, Jane On Fri, Sep 22, 2023 at 2:13 PM Chen Zhanghao wrote: > Hi Jane, > > Thanks for the suggestions and totally agree with them. I've updated the > FLIP

回复: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-21 Thread Chen Zhanghao
ource but forget to declare the primary key constraint. Best, Jane On Wed, Sep 20, 2023 at 9:20 AM Benchao Li wrote: > Thank you for the update, the FLIP now looks good to me. > > Chen Zhanghao 于2023年9月19日周二 22:50写道: > > > > Thanks to everyone for the valuable inputs, we lea

回复: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-19 Thread Chen Zhanghao
Thanks for driving this, Xiangyu. We use Session clusters for quick SQL debugging internally, and found cold-start job submission slow due to lack of the exact minimum resource reservation feature proposed here. This should improve the experience a lot for running short lived-jobs in session clu

回复: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-19 Thread Chen Zhanghao
ces > > > > + 1 Thanks for the FLIP and the discussion. I would like to ask whether > to > > use SQL Hint syntax to set this parallelism? > > > > Martijn Visser 于2023年9月15日周五 20:52写道: > > > > > Hi everyone, > > > > > > Thanks for the FL

回复: [VOTE] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-19 Thread Chen Zhanghao
//lists.apache.org/thread/sls1196mmk25w8nm2qf585254nbjr9hd Best, Zhanghao Chen ____ 发件人: Chen Zhanghao 发送时间: 2023年9月18日 19:19 收件人: dev@flink.apache.org ; Jing Ge 主题: 回复: [VOTE] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI Thanks for pointing that

回复: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-18 Thread Chen Zhanghao
发件人: Rui Fan 发送时间: 2023年9月19日 12:16 收件人: Chen Zhanghao ; dev 主题: Re: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI +1, thanks everyone who discussed here. Best, Rui On Tue, 19 Sep 2023 at 11:41, Chen Zhanghao mailto:zhangha

回复: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-18 Thread Chen Zhanghao
tEndpoint() is better. > TaskManagerLocation.getLocation(), > TaskManagerLocation.getLocationAsString(), or similar names in that > direction are even worse. > > Best regards, > Jing > > On Wed, Sep 13, 2023 at 2:52 PM Chen Zhanghao > wrote: > > > Hi Jing, > > > >

回复: [VOTE] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-18 Thread Chen Zhanghao
gt; Yangze Guo > > On Mon, Sep 18, 2023 at 11:37 AM Chen Zhanghao > wrote: > > > > Hi All, > > > > Thanks for all the feedback on FLIP-363: Unify the Representation of > TaskManager Location in REST API and Web UI [1][2] > > > > I'd like to start

[VOTE] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-17 Thread Chen Zhanghao
Hi All, Thanks for all the feedback on FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI [1][2] I'd like to start a vote for FLIP-363. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1] https://cwiki.apache.org/c

回复: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-17 Thread Chen Zhanghao
FLIP-321, if we want to deprecate the host field, we should annotate the related field / getter / setter with @Deprecated in this version, and keep them at least 2 minor releases. Best, Yangze Guo On Wed, Sep 13, 2023 at 8:52 PM Chen Zhanghao wrote: > > Hi Jing, > > Thanks for the

回复: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-15 Thread Chen Zhanghao
to solve > when we introduced this feature internally. I'd like to hear more > opinions on this. Personally I'm ok to leave it out of this FLIP for > the time being. > > Chen Zhanghao 于2023年9月14日周四 14:46写道: > > > > Hi Devs, > > > > Dewei (cced) a

回复: [DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-15 Thread Chen Zhanghao
tially want to solve when we introduced this feature internally. I'd like to hear more opinions on this. Personally I'm ok to leave it out of this FLIP for the time being. Chen Zhanghao 于2023年9月14日周四 14:46写道: > > Hi Devs, > > Dewei (cced) and I would like to start a discuss

回复: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-15 Thread Chen Zhanghao
understanding of FLIP-321, if we want to deprecate the host field, we should annotate the related field / getter / setter with @Deprecated in this version, and keep them at least 2 minor releases. Best, Yangze Guo On Wed, Sep 13, 2023 at 8:52 PM Chen Zhanghao wrote: > > Hi Jing, > > Th

[DISCUSS] FLIP-367: Support Setting Parallelism for Table/SQL Sources

2023-09-13 Thread Chen Zhanghao
Hi Devs, Dewei (cced) and I would like to start a discussion on FLIP-367: Support Setting Parallelism for Table/SQL Sources [1]. Currently, Flink Table/SQL jobs do not expose fine-grained control of operator parallelism to users. FLIP-146 [2] brings us support for setting parallelism for sinks

回复: [VOTE] FLIP-361: Improve GC Metrics

2023-09-13 Thread Chen Zhanghao
+1 (unbinding). Looking forward to it Best, Zhanghao Chen 发件人: Gyula Fóra 发送时间: 2023年9月13日 21:16 收件人: dev 主题: [VOTE] FLIP-361: Improve GC Metrics Hi All! Thanks for all the feedback on FLIP-361: Improve GC Metrics [1][2] I'd like to start a vote for it. The vo

回复: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread Chen Zhanghao
Thanks for driving this. +1 (non-binding) Best, Zhanghao Chen 发件人: Rui Fan <1996fan...@gmail.com> 发送时间: 2023年9月13日 10:52 收件人: dev 主题: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler Hi all, Thanks for all the feedback

回复: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-13 Thread Chen Zhanghao
me to remove > it in the future release. > > Best, > Weihua > > > On Mon, Sep 11, 2023 at 11:48 AM Chen Zhanghao > wrote: > > > Hi Fan Rui, > > > > Thanks for clarifying the definition of "public interfaces", that helps a > > lot! > &g

回复: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-10 Thread Chen Zhanghao
; Consider a scenario where a machine (host) with multiple TaskManagers has > poor processing performance due to some problems. > By using a host field aggregation, I can identify the problems with this > machine and take it offline. > > Best, > Weihua > > > On Mon

回复: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-10 Thread Chen Zhanghao
e due to some problems. By using a host field aggregation, I can identify the problems with this machine and take it offline. Best, Weihua On Mon, Sep 11, 2023 at 10:34 AM Chen Zhanghao wrote: > Hi Shammon, > > I think all REST API response messages (e.g. > SubtaskExecutionAtte

回复: [DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-10 Thread Chen Zhanghao
ant to annotate them as `Plublic`? If not, I think you may need to move them from `Public Interfaces` to `Proposed Changes`. Best, Shammon FY On Sat, Sep 9, 2023 at 12:11 PM Chen Zhanghao wrote: > Hi Devs, > > I would like to start a discussion on FLIP-363: Unify the Representation &

[DISCUSS] FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI

2023-09-08 Thread Chen Zhanghao
Hi Devs, I would like to start a discussion on FLIP-363: Unify the Representation of TaskManager Location in REST API and Web UI [1]. The TaskManager location of subtasks is important for identifying TM-related problems. There are a number of places in REST API and Web UI where TaskManager loc

回复: [DISSCUSS] Kubernetes Operator Flink Version Support Policy

2023-09-05 Thread Chen Zhanghao
+1 for the proposal. A side question: how will we handle a major Flink version given that Flink 2.0 is around the corner. Best, Zhanghao Chen 发件人: Gyula Fóra 发送时间: 2023年9月5日 20:12 收件人: dev 抄送: Maximilian Michels ; Thomas Weise ; Márton Balassi ; morh...@apache.

[REQUEST] Edit Permissions for FLIP

2023-09-05 Thread Chen Zhanghao
Hi folks, I'm writing to request the edit permission for FLIP. My Confluence Wiki ID is: zhanghao.chen. I've recently reported two JIRA issues and was reminded of the need to create a FLIP for each of them as they would change the public API: 1. [FLINK-25371] Include data port as part of the

回复: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-03 Thread Chen Zhanghao
Congratulations, Weihua! Best, Zhanghao Chen 发件人: Xintong Song 发送时间: 2023年8月4日 11:18 收件人: dev 抄送: Weihua Hu 主题: [ANNOUNCE] New Apache Flink Committer - Weihua Hu Hi everyone, On behalf of the PMC, I'm very happy to announce Weihua Hu as a new Flink Committer!

回复: Scaling Flink Jobs without Restarting Job

2023-07-23 Thread Chen Zhanghao
Hi Talat, In reactive mode, rescaling is performed by a whole-graph failover, which is already less costly compared to a full job restart where all containers need to be requested again. For simple stateless jobs, this usually won't take long (a few seconds), you can measure how long it takes f

回复: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-23 Thread Chen Zhanghao
Congrats, Shammon! Best, Zhanghao Chen 发件人: Weihua Hu 发送时间: 2023年7月24日 11:11 收件人: dev@flink.apache.org 抄送: Shammon FY 主题: Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang Congratulations! Best, Weihua On Mon, Jul 24, 2023 at 11:04 AM Paul Lam wrote: >