Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-06-28 Thread feng xiangyu
Hi Dong and Yunfeng, Thanks for the proposal, your flip sounds very useful from my perspective. In our business, when we using hybrid source in production we also met the problem described in your flip. In our solution, we tend to skip making any checkpoints before all batch tasks have finished an

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-06-28 Thread feng xiangyu
nterval-during-backlog > to say the following: > ... it is not null, the value must either be 0, which means the checkpoint > is disabled during backlog, or be larger than or equal to > execution.checkpointing.interval. > > Does this address your need? > > Best, > Dong &g

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

2023-06-29 Thread feng xiangyu
+1 (non-binding) Best, Xiangyu yuxia 于2023年6月29日周四 20:44写道: > +1 (binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Yuepeng Pan" > 收件人: "dev" > 发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14 > 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when > source is processing

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-10 Thread feng xiangyu
Hi David, Thanks for creating this flip. I think this work it is very useful, especially in autoscaling scenario. I would like to share some questions from my view. 1, Is it possible for this REST API to declare TM resources in the future? I'm asking because we are building the autoscaling featu

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

2023-02-13 Thread feng xiangyu
> requirements for all vertices in the JobGraph; This is completely fine for > the programmatic workflows. For DEBUG / DEMO purposes, you can use the GET > endpoint and tweak the response to avoid writing the whole payload by hand. > > WDYT? > > > Best, > D. > > On Fr

Re: [VOTE] FLIP-291: Externalized Declarative Resource Management

2023-02-28 Thread feng xiangyu
+1 (non-binding) ConradJam 于2023年3月1日周三 10:37写道: > +1 (non-binding) > > Zhanghao Chen 于2023年3月1日周三 10:18写道: > > > Thanks for driving this. +1 (non-binding) > > > > Best, > > Zhanghao Chen > > > > From: David Mor?vek > > Sent: Tuesday, February 28, 2023 21:46

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-27 Thread feng xiangyu
Congrats Yu! Looking forward to contributing to Paimon! Best Regards, Xiangyu yuxia 于2023年3月27日周一 21:01写道: > congratulations! > > Best regards, > Yuxia > > > 发件人: "Andrew Otto" > 收件人: "Matthias Pohl" > 抄送: "Jing Ge" , "Leonard Xu" , "Yu > Li" , "dev" , "User" < > u...@flink.apache.org>, "user