Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

Congratulations, Leonard! Best, Junrui Wencong Liu 于2023年4月23日周日 11:05写道： > Congratulations, Leonard! > > Best, > Wencong LIu > > > > > > > > > > > > > > > > At 2023-04-21 19:47:52, "Jark Wu" wrote: > >Hi everyone, > > > >We are thrilled to announce that Leonard Xu has joined the Flink PMC! >

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

Congratulations, Qingsheng! Best, Junrui Wencong Liu 于2023年4月23日周日 11:07写道： > Congratulations, Qingsheng! > > Best, > Wencong LIu > > > > > > > > > > > > > > > > At 2023-04-21 19:47:52, "Jark Wu" wrote: > >Hi everyone, > > > >We are thrilled to announce that Leonard Xu has joined the Flink PMC

Re: Re: Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

+1 Best, Junrui Jing Ge 于2023年7月24日周一 23:28写道： > agree, since we want to try our best to deprecate APIs in 1.18, it makes > sense. > > > Best regards, > Jing > > On Mon, Jul 24, 2023 at 12:11 PM Wencong Liu wrote: > > > Hi Jing and Matthias, > > > > > > I believe it is reasonable to examin

Re: Re: [DISCUSS][2.0] FLIP-344: Remove parameter in RichFunction#open

+1 Best, Junrui Wencong Liu 于2023年7月24日周一 20:12写道： > Hi Timo, > > > Thanks for you reply. I think adding an empty OpenContext to keep the > signature is > reasonable. I'll modify the FLIP at a later time. > > > Best, > Wencong Liu > > > > > > > > > > > > > > > > > > At 2023-07-24 17:11:44, "Tim

Re: [DISCUSS][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

+1 Best, Junrui weijie guo 于2023年7月24日周一 10:25写道： > +1 for this. > > Best regards, > > Weijie > > > liu ron 于2023年7月24日周一 09:58写道： > > > +1 > > > > Best, > > Ron > > > > Yuxin Tan 于2023年7月21日周五 16:21写道： > > > > > +1 > > > > > > Best, > > > Yuxin > > > > > > > > > Jing Ge 于2023年7月21日周五 15:41写

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

Congrats, Weihua! Best, Junrui Geng Biao 于2023年8月4日周五 14:25写道： > Congrats, Weihua! > Best, > Biao Geng > > 发送自 Outlook for iOS > > 发件人: 周仁祥 > 发送时间: Friday, August 4, 2023 2:23:42 PM > 收件人: dev@flink.apache.org > 抄送: Weihua Hu > 主题: Re: [

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

Congratulations Yanfei! Best, Junrui Yun Tang 于2023年8月7日周一 15:19写道： > Congratulations, Yanfei! > > Best > Yun Tang > > From: Danny Cranmer > Sent: Monday, August 7, 2023 15:10 > To: dev > Subject: Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei > > Cong

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

Congratulations, Hangxiang! Best, Junrui Yun Tang 于2023年8月7日周一 15:19写道： > Congratulations, Hangxiang! > > Best > Yun Tang > > From: Danny Cranmer > Sent: Monday, August 7, 2023 15:11 > To: dev > Subject: Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

[Discuss] FLIP-366: Support standard YAML for FLINK configuration

Hi devs, I would like to start a discussion about FLIP-366: Support standard YAML for FLINK configuration[1] The current flink-conf.yaml parser in FLINK is not a standard YAML parser, which has some shortcomings. Firstly, it does not support nested structure configuration items and only supports

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

determine which one uses the standard syntax at a glance. How about > using `flink-conf-default.yaml` to represent the default yaml file for > Flink 1.x? > > Best, > Jane > > On Wed, Sep 20, 2023 at 11:06 AM Junrui Lee wrote: > > > Hi devs, > > > > I wo

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

;> Yangze Guo > >>>>> > >>>>> > >>>>> On Fri, Sep 22, 2023 at 11:59 AM Lijie Wang < > >> wangdachui9...@gmail.com> > >>>>> wrote: > >>>>>> Hi Junrui, > >>>>>> &

Re: [Discuss] FLIP-366: Support standard YAML for FLINK configuration

Hi everyone, Thanks for all the comments! Based on the discussion so far, I will proceed to initiate the vote tomorrow if there are no further discussions or objections. Best regards, Junrui Junrui Lee 于2023年10月9日周一 11:52写道： > Hi, Chesnay and David, sorry for the late reply. > > T

[VOTE] FLIP-366: Support standard YAML for FLINK configuration

Hi all, Thank you to everyone for the feedback on FLIP-366[1]: Support standard YAML for FLINK configuration in the discussion thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours (excluding weekends, unless there is an objection or an insufficient number of

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

Congratulations Ron ! Best, Junrui Yun Tang 于2023年10月16日周一 10:22写道： > Congratulations, Ron! > > Best > Yun Tang > > From: yu zelin > Sent: Monday, October 16, 2023 10:16 > To: dev@flink.apache.org > Cc: ron9@gmail.com > Subject: Re: [ANNOUNCE] New Apache

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

Congratulations Jane ! Best, Junrui Yun Tang 于2023年10月16日周一 10:21写道： > Congratulations, Jane! > > Best > Yun Tang > > From: Rui Fan <1996fan...@gmail.com> > Sent: Monday, October 16, 2023 10:16 > To: dev@flink.apache.org > Cc: qingyue@gmail.com > Subject:

[RESULT][VOTE] FLIP-366: Support standard YAML for FLINK configuration

Hi all, The voting time of FLIP-366 [1]:Support standard YAML for FLINK configuration has passed. I'm closing the vote now. There were 18 +1 votes, 9 of which are binding: Rui Fan (binding) Weijie Guo (binding) Yangze Guo (binding) Lijie Wang (binding) Jing Ge (binding) Zhu Zhu (binding) Chesnay

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

Hi Zhanghao, Thank you for the proposal. +1 from my side. It would be more user-friendly to have the deprecated options in the same section as the non-deprecated ones. Therefore, adding them in the same section sounds good to me. Best regards, Junrui Zhanghao Chen 于2023年11月1日周三 21:10写道： > Hi

[DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

on this proposal are highly appreciated. Best regards, Junrui Lee [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=278464992

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

> presents a great opportunity to accomplish this goal. > > > > > > > > > > +1 for the proposal. > > > > > > > > > > Thanks, > > > > > Zhu > > > > > > > > > > Rui Fan <1996fan...@gmail.com&g

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

t; approach to configuring Flink applications. > > > > +1 for this proposal. > > > > Best, > > Wencong Liu > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > At 2023-11-02 10:10:1

[VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Hi everyone, Thank you to everyone for the feedback on FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects[1] which has been discussed in this thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours (excluding weekends) unles

[RESULT][VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

Hi all, The voting time of FLIP-381[1]: Deprecate configuration getters/setters that return/set complex Java objects has passed. I'm closing the vote now. There were 12 +1 votes, 6 of which are binding: Rui Fan (binding) Weijie Guo (binding) Yangze Guo (binding) Lijie Wang (binding) Jing Ge (bin

[DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

Hi all, I'd like to start a discussion of FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1]. Currently, the FLINK RuntimeContext is important for connecting user functions to the underlying runtime details. It provides users with necessary runtime information during job execution. However,

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

u Zhu wrote: > >> Thanks Junrui for creating the FLIP and kicking off this discussion. >> >> Exposing a mutable ExecutionConfig which is even shared by multiple >> operators is truly a defect which can result in weird results. >> >> +1 >> >> Thanks, >&

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

clean up the codebase. > > > +1 (non-binding). > > > Best, > Wencong > > > > > > > > > > > > > > > > > > > > At 2023-11-15 16:51:15, "Junrui Lee" wrote: > >Hi all, > > > >I'd like to start a disc

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

more than 30 methods > offered flat by the RuntimeContext. I am not sure if this could help users > find the right method in the context of execution config better than > before. > > I might miss something and look forward to your thoughts. Thanks! > > Best regards, >

[VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

Hi everyone, Thank you to everyone for the feedback on FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1] which has been discussed in this thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours unless there is an objection or not enough votes. [1] http

[RESULT][VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

The voting time of FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1] has passed. I'm closing the vote now. There were 5 +1 votes, 4 of which are binding: Rui Fan (binding) Weijie Guo (binding) Jing Ge (binding) Zhu Zhu (binding) Zhanghao Chen (non-binding) There were no -1 votes. Thus F

Re: [DISCUSS] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

Hi Zakelly, Thanks for driving this. I agree that the proposed restructuring of the configuration options is largely positive. It will make understanding and working with Flink configurations more intuitive. Most of the proposed changes look great. Just a heads-up, as Rui Fan mentioned, Flink cur

Re: FW: [ANNOUNCE] New Apache Flink Committer - Alexander Fedulov

Congratulations, Alex! Best, Junrui weijie guo 于2024年1月4日周四 09:57写道： > Congratulations, Alex! > > Best regards, > > Weijie > > > Steven Wu 于2024年1月4日周四 02:07写道： > > > Congra, Alex! Well deserved! > > > > On Wed, Jan 3, 2024 at 2:31 AM David Radley > > wrote: > > > > > Sorry for my typo. > > >

[DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

ch+Scheduler [3]:https://issues.apache.org/jira/browse/FLINK-29663 [4]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-168%3A+Speculative+Execution+for+Batch+Job Best regards, JunRui Lee

Re: [DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

> > > So generally +1 for this proposal. > > > > Regarding the configuration key renaming, like yuxia mentioned, we should > > deprecate the old ones and add new ones with new names, to guarantee > > compatibility. > > > > Thanks, > > Zhu > > &

[VOTE] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

Hi all, Thanks for all the feedback so far. Based on the discussion[1], we have come to a consensus, so I would like to start a vote on FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs[2]. The vote will last for at least 72 hours (Jan 12th at 12:00 GMT) unless there is a

Re: Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

Congratulations, Lincoln! Best regards, Junrui Wencong Liu 于2023年1月10日周二 14:40写道： > Congratulations, Lincoln! > > Best regards, > Wencong > > > > > > > > > > > > > > > 在 2023-01-10 13:25:09，"Yanfei Lei" 写道： > >Congratulations, well deserved! > > > >Best, > >Yanfei > > > >Yuan Mei 于2023年1月10日周

Re: [DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

aming > dedicated. That should significantly simplify the default scheduler, > benefiting both the maintenance of the default scheduler and the > development of new features in the batch area. > > So +1 from my side. > > Best, > > Xintong > > > > On Wed, Jan 4,

[RESULT][VOTE] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

Hi all: FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs [1] has been accepted. The FLIP was voted in this thread[2]. There are 3 bindings, and 2 non-bindings as follows: Lijie Wang (binding) Zhu Zhu (binding) yuxia (non-binding) weijie guo (non-binding) Xintong Song (b

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

Congratulations, Weijie! Best, Junrui

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

Congratulations, Dong! Best, Junrui Guowei Ma 于2023年2月16日周四 14:21写道： > Hi, everyone > > On behalf of the PMC, I'm very happy to announce Dong Lin as a new > Flink PMC. > > Dong is currently the main driver of Flink ML. He reviewed a large > number of Flink ML related PRs and also partic

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

Congratulations, Anton! Best, Junrui Rui Fan 于2023年2月21日周二 10:02写道： > Congratulations, Anton! > > Best, > Rui Fan > > On Tue, Feb 21, 2023 at 9:23 AM yuxia wrote: > > > Congrats Anton! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Matthias Pohl" > > 收件人: "dev" > > 发送时间:

Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan

Congratulations, Rui Best, Junrui Matt Wang 于2023年2月21日周二 09:51写道： > Congrats Rui > > > -- > > Best, > Matt Wang > > > Replied Message > | From | yuxia | > | Date | 02/21/2023 09:22 | > | To | dev | > | Subject | Re: [ANNOUNCE] New Apache Flink Committer - Rui Fan | > Congrats Rui > >

Re: [ANNOUNCE] New Apache Flink Committer - Sergey Nuyanzin

Congratulations Sergey! weijie guo 于2023年2月21日周二 20:54写道： > Congratulations, Sergey~ > > Best regards, > > Weijie > > > Jing Ge 于2023年2月21日周二 20:52写道： > > > congrats Sergey! > > > > On Tue, Feb 21, 2023 at 1:15 PM Matthias Pohl > > wrote: > > > > > Congratulations, Sergey! Good job & well-dese

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Thanks Martijn for your great work. Best regards, Junrui Jane Chan 于2023年2月24日周五 10:37写道： > Thanks Martijn for your great work. > > Best regards, > Jane > > On Fri, Feb 24, 2023 at 10:24 AM weijie guo > wrote: > > > Thanks Martijn for your great work. > > > > Best regards, > > > > Weijie > > >

Re: [VOTE] Flink minor version support policy for old releases

Thanks Danny for driving it. +1 (non-binding) Best regards, Junrui yuxia 于2023年2月28日周二 14:04写道： > Thanks Danny for driving it. > > +1 (non-binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Weihua Hu" > 收件人: "dev" > 发送时间: 星期二, 2023年 2 月 28日 下午 12:48:09 > 主题: Re: [VOTE] Flink min

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

Hi Yuxin, This FLIP looks quite reasonable. Flink can solve the problem of Batch shuffle by combining local and remote storage, and can use fixed local disks for better performance in most scenarios, while using remote storage as a supplement when local disks are not sufficient, avoiding wastefu

Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

Congratulations, Yuxia! Best, Junrui Yanfei Lei 于2023年3月13日周一 10:42写道： > Congratulations, Yuxia! > > Best, > Yanfei > > > Samrat Deb 于2023年3月13日周一 10:41写道： > > > > congratulations Yuxia > > > > Bests, > > Samrat > > > > On Mon, 13 Mar 2023 at 8:06 AM, Yuxin Tan > wrote: > > > > > Congratulati

Re: [VOTE] Release 1.17.0, release candidate #2

Thanks Qingsheng for driving this. +1 (non-binding) - built from source code - run some batch jobs, query results are expected, the default batch scheduler is AdaptiveBatchScheduler, WebUI looks good, no suspicious output/log. - start a Flink yarn session cluster, run the 10TB tpc-ds, all job can

Re: [VOTE] FLIP-301: Hybrid Shuffle supports Remote Storage

+1 (non-binding) Best regards, Junrui Weihua Hu 于2023年3月20日周一 14:24写道： > +1 (non-binding) > > Best, > Weihua > > > On Mon, Mar 20, 2023 at 12:39 PM Wencong Liu wrote: > > > +1 (non-binding) > > > > Best regards, > > > > Wencong Liu > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >

Re: [DISCUSS] Move CheckpointingMode to flink-core

Hi Zakelly, I agree with Chesnay's response. I would suggest that during the process of moving CheckpointingMode from the flink-streaming-java module to the flink-core module, we should keep the package name unchanged. This approach would be completely transparent to users. In fact, this practice

Re: [DISCUSS] Move CheckpointingMode to flink-core

tion 3 if we all > agree, since the new getter/setter may also bring in confusions thus we > cannot make the API purely clean. WDYT? > > > Best, > Zakelly > > On Wed, Feb 28, 2024 at 10:14 AM Junrui Lee wrote: > > > Hi Zakelly, > > > > I agree with Chesn

Re: Question around Flink's AdaptiveBatchScheduler

Hi Venkat, As Lijie mentioned, in Flink, the parallelism is required to be less than or equal to the maximum parallelism. The config option jobmanager.adaptive-batch-scheduler.max-parallelism and jobmanager.adaptive-batch-scheduler.default-source-parallelism will be set as the source's parallelis

Re: Question around Flink's AdaptiveBatchScheduler

ices other than the > > source vertex. As you mentioned above ("Source can actually ignore this > > limit because it has no upstream"), therefore I feel " > > jobmanager.adaptive-batch-scheduler.default-source-parallelism" need not > > be upper bounded by

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

+1 （non-binding) Best, Junrui Lijie Wang 于2024年4月12日周五 12:43写道： > +1 (binding) > > Thanks for driving. > > Best, > Lijie > > Zakelly Lan 于2024年4月12日周五 11:08写道： > > > +1 non-binding > > > > > > Best, > > Zakelly > > > > On Fri, Apr 12, 2024 at 11:05 AM Yuepeng Pan > > wrote: > > > > > Hi Rui,

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

Congratulations, Jing! Best, Junrui Aleksandr Pilipenko 于2024年4月12日周五 18:28写道： > Congratulations, Jing! > > Best Regards, > Aleksandr >

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

Congratulations, Lincoln! Best, Junrui Aleksandr Pilipenko 于2024年4月12日周五 18:29写道： > Congratulations, Lincoln! > > Best Regards > Aleksandr >

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

Congratulations, Zakelly! Best, Junrui yue ma 于2024年4月15日周一 12:00写道： > Congratulations Zakelly! > > Best, > Yue >

Re: Question around Flink's AdaptiveBatchScheduler

t; > > be bound by the overall job's max parallelism, it can lead to following > > > issues: > > > > > >- High filter selectivity with huge amounts of data to read - > setting > > >high "*jobmanager.adaptive-batch-scheduler.max-parallelism*

Re: Question around Flink's AdaptiveBatchScheduler

gt; vsowr...@asu.edu> wrote: > > > >> Filed https://issues.apache.org/jira/browse/FLINK-35165 to address the > >> above described issue. Will share the PR here once it is ready for > review. > >> > >> Regards > >> Venkata krishnan &

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

Thanks Xuannan for driving this! +1 for this proposal. Best, Junrui Rui Fan <1996fan...@gmail.com> 于2024年5月6日周一 11:27写道： > Thanks Xuannan for driving this proposal! > > > taskmanager.network.memory.max-overdraft-buffers-per-gate will be removed > and hard-coded to either 10 or 20. > > Currently,

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

Congratulations Weijie! Best, Junrui Xintong Song 于2024年6月4日周二 14:46写道： > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Weijie Guo has joined > the Flink PMC! > > Weijie has been an active member of the Apache Flink community for many > years. He has made significant co

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

Thanks Yuxin for driving this proposal! I have a question about the public interface compatibility in the context of FLIP-459. As we've supported batch job recovery from jobMaster failures in FLIP-383 which will be released in Flink 1.20. I wonder if the current interface design support the future

Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

Congratulations, Rui. Best, Junrui Hang Ruan 于2024年6月6日周四 10:35写道： > Congratulations, Rui! > > Best, > Hang > > Samrat Deb 于2024年6月6日周四 10:28写道： > > > Congratulations Rui > > > > Bests, > > Samrat > > > > On Thu, 6 Jun 2024 at 7:45 AM, Yuxin Tan wrote: > > > > > Congratulations, Rui! > > > >

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

ecovery, I propose that this FLIP > doesn't involve these particular changes. Moreover, considering that > the Tier interfaces are not public currently, it is also feasible to add > the interfaces directly if necessary. > WDYT? > > Best, > Yuxin > > > Junrui Lee

Re: [VOTE] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

+1 (non-binding) Best, Junrui Venkatakrishnan Sowrirajan 于2024年6月10日周一 02:37写道： > Thanks for adding this new support. +1 (non-binding) > > On Sat, Jun 8, 2024, 3:26 PM Ahmed Hamdy wrote: > > > +1 (non-binding) > > Best Regards > > Ahmed Hamdy > > > > > > On Sat, 8 Jun 2024 at 22:26, Jeyhun Kar

Re: [VOTE] FLIP-464: Merge "flink run" and "flink run-application"

+1 (non-binding) Best, Junrui Biao Geng 于2024年6月13日周四 09:54写道： > Thanks for driving this. > +1 (non-binding) > > Best, > Biao Geng > > > weijie guo 于2024年6月13日周四 09:48写道： > > > Thanks for driving this! > > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xintong Song 于2024年6月1

Re: [ANNOUNCE] New Apache Flink Committer - Lijie Wang

Congratulations, Lijie! Best, JunRui Timo Walther 于2022年8月17日周三 19:30写道： > Congratulations and welcome to the committer team :-) > > Regards, > Timo > > > On 17.08.22 12:50, Yuxin Tan wrote: > > Congratulations, Lijie! > > > > Best, > > Yuxin > > > > > > Guowei Ma 于2022年8月17日周三 18:42写道： > > >

Re: [VOTE] Release 1.16.0, release candidate #2

+1 (non-binding) for this candidate * Built from the source code. * Ran batch wordcount jobs with slow nodes of different source types on the yarn cluster. * The new source speculative execution works as expected, the result is expected, no suspicious log output. * Slow nodes are s

Re: [DISCUSS] FLIP-271: Autoscaling

roper triggering rules are necessary to avoid unnecessary autoscaling caused by temporary large changes in data, and in this case, it will lead to at least two meaningless resubmissions of jobs, which will negatively affect users. Thanks, JunRui Lee Gyula Fóra 于2022年11月5日周六 20:38写道： > Hey! &g

Re: [DISCUSS] FLIP-271: Autoscaling

@Guyla, Thanks for the explanation and the follow up actions. That sounds good to me. Thanks, JunRui Lee Yanfei Lei 于2022年11月7日周一 12:20写道： > Hi Max, > > Thanks for the proposal. This proposal makes Flink better adapted to > cloud-native applications! > > After reading the

[DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

the job at runtime, to enhance the job's execution performance and observability. For more details, please refer to FLIP-468 [1]. We look forward to your feedback. Best, Xia Sun, Lei Yang and Junrui Lee [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-468%3A+Introducing+Stream

[DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

]. We look forward to your feedback. Best, Xia Sun, Lei Yang and Junrui Lee [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-468%3A+Introducing+StreamGraph-Based+Job+Submission [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-469%3A+Supports+Adaptive+Optimization+of+StreamGraph

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

Hi all, Thanks for your feedback. Below are my thoughts on the questions you've raised @Fabian - What is the future plan for job submissions in Flink? With the current > proposal, Flink will support JobGraph/StreamGraph/compiled plan > submissions? It might be confusing for users and complicate

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

uld also involve the public interface, so instead of > postponing > it to a later FLIP, I prefer to have a design for it in this FLIP. WDYT? > > Thanks, > Zhu > > Junrui Lee 于2024年7月11日周四 11:27写道： > > > Hi devs, > > > > Xia Sun, Lei Yang, and I would like t

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

9写道： > > > Thanks Junrui for the updates. The proposal looks good to me. > > With the stream graph added to the REST API result, I think we are > > also quite close to enable Flink to expand a job vertex to show its > > operator-chain topology. > > >

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

regards, Junrui Junrui Lee 于2024年7月12日周五 20:29写道： > Hi all, > > Thanks for your feedback. Below are my thoughts on the questions you've > raised > > @Fabian > > - What is the future plan for job submissions in Flink? With the current >> proposal, Flink will su

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

se two optimization > > strategies a, b are executed in order, a must be executed first, then b. > > How do you let the user perceive that a must be in front of a when > setting > > parameters, and a must be behind, and can the list type always be >

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

pdated FLIP-468 & FLIP-470, I see that the design looks > good. > > > Best. > Ron > > Junrui Lee 于2024年7月18日周四 14:26写道： > > > Hi all, > > > > I would like to follow up on my previous email regarding your feedback. > > Below > > is a c

[VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

Hi everyone, Thanks for all the feedback about FLIP-468: Introducing StreamGraph-Based Job Submission [1]. The discussion thread can be found here [2]. The vote will be open for at least 72 hours unless there are any objections or insufficient votes. Best, Junrui [1] https://cwiki.apache.org/c

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

. Best, Junrui Junrui Lee 于2024年7月24日周三 15:46写道： > Hi Ron, > > Thank you for your questions regarding the > StreamGraphOptimizationStrategy. Here are my responses: > > 1.is there a better way to pass it to the > runtime? > > At the moment, we have not thought of a

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

Hi all, Thank you for all the feedback and suggestions so far. If there are no further comments, we will open the voting thread next Monday, July 29, 2024. Best regards, Junrui Ron Liu 于2024年7月26日周五 14:17写道： > Thanks for your updated, the FLIP looks good to me. > > Junrui Lee 于202

[VOTE] FLIP-469: Supports Adaptive Optimization of StreamGraph

Hi everyone, Thanks for all the feedback about FLIP-469: Supports Adaptive Optimization of StreamGraph [1]. The discussion thread can be found here [2]. The vote will be open for at least 72 hours unless there are any objections or insufficient votes. Best, Junrui [1] https://cwiki.apache.org/

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

o explore the job > > they submitted. > > > > It's an important cornerstone of the FLINK-33230 since there are no > > stream-graph informations serialized. > > I'd like to base on this flip to expose operator level metrics and the > > present

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

t; > On Fri, Jul 26, 2024 at 9:30 AM Zhanghao Chen > wrote: > > > Thanks for driving it. +1 (non-binding) > > > > Best, > > Zhanghao Chen > > > > From: Junrui Lee > > Sent: Friday, July 26, 2024 11:02 > > To:

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

le work and > > risk to turn it into a serializable. Directly serializing and submitting > > transformations is also acceptable at the first glance, but > > SinkTransformation seems to be a blocker, as Junrui just mentioned. > > > > Thanks, > > Zhu > > >

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

Hi Yu Chen, Apologies for the late reply. Thanks for your feedback and for emphasizing the importance of this work for FLINK-33230. Looking forward to your contributions. Best, Junrui Junrui Lee 于 2024年8月6日周二 22:05写道： > Hi everyone, > > David, Zhu and I had an offline discussion a

[RESULT][VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

Hi everyone, I'm delighted to announce that FLIP-468 [1] has been accepted. There were 6 votes in favor: - Rui Fan (binding) - Zhu Zhu (binding) - Ron Liu (binding) - David Moravek (binding) - Zhanghao Chen (non-binding) - Yuepeng Pan (non-binding) There were no votes against it. [1] https://cw

[RESULT][VOTE] FLIP-469: Supports Adaptive Optimization of StreamGraph

Hi everyone, I'm delighted to announce that FLIP-469 [1] has been accepted. There were 3 votes in favor: - Weijie Guo (binding) - Zhu Zhu (binding) - Ron Liu (binding) There were no votes against it. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-469%3A+Supports+Adaptive+Optimizatio

Re: [ANNOUNCE] New Apache Flink Committer - Xuannan Su

Congratulations, Xuannan! Best, Junrui Feng Jin 于2024年8月18日周日 16:34写道： > Congratulations, Xuannan! > > Best, > Feng > > > On Sun, Aug 18, 2024 at 3:08 PM Rui Fan <1996fan...@gmail.com> wrote: > > > Congratulations, Xuannan! > > > > Best, > > Rui > > > > On Sun, Aug 18, 2024 at 2:20 PM Leonard X

[DISCUSS] FLIP-478: Introduce Config Option Scope

igure each config option. And the scopes should be displayed in Flink configuration documentation. For more details, please refer to FLIP-478 [1]. Looking forward to your feedback. Best, Junrui Lee [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-478+Introduce+Config+Option+Scope

Re: [VOTE] Release 2.0-preview1, release candidate #1

+1 (non-binding) - Verified checksums - Checked GitHub release tag - Reviewed web PR and release note - Built from source - Started the flink cluster locally and run an example job, and everything looks fine Best, Junrui Xintong Song 于2024年10月13日周日 00:46写道： > Hi everyone, > > Please review and

Re: [DISCUSS] FLIP-478: Introduce Config Option Scope

g the > > > scopes of various configurations, such as attempting to retrieve > > > job-specific settings from `TaskExecutor#taskManagerConfiguration`. > > > Clarifying the options' scopes in documentation can be a good reference > > > and

Re: [DISCUSS] FLIP-478: Introduce Config Option Scope

] https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/config/ Best, Junrui Rui Fan <1996fan...@gmail.com> 于2024年10月10日周四 11:33写道： > Thanks Junrui for the quick clarification! > > Sounds good to me, +1 for this FLIP. > > Best, > Rui > > On Thu, Oct 1

[RESULT][VOTE] FLIP-478: Introduce Config Option Scope

Hi everyone, I'm glad to announce that FLIP-478: Introduce Config Option Scope[1] has been accepted. There are 3 approving votes, all of which are binding: - Zhu Zhu (binding) - Rui Fan (binding) - Shengkai Fang (binding) There were no votes against it. Best, Junrui [1] https://cwiki.apache.or

Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

Thanks Shengakai for driving this proposal. Supporting the deployment of sql scripts in application mode is important for improving SQL job submission. This FLIP design looks good to me. Best, Junrui Ron Liu 于2024年10月31日周四 10:20写道： > Hi, Shengkai > > Thanks for your quick response. It looks goo

[VOTE] FLIP-478: Introduce Config Option Scope

Hi devs, I'd like to start a vote on the FLIP-478: Introduce Config Option Scope[1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-478+Introduce+Config+

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

Thank you so much for your kind congratulations and warm welcome! Looking forward to contributing more to the community. Best, Junrui Ron Liu 于2024年11月7日周四 17:00写道： > Congratulations Junrui > > Best, > Ron > > wenjin 于2024年11月7日周四 11:57写道： > > > Congratulations Junrui~ > > > > Best regards, >

Re: [DISCUSS] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

Hi, Xu Thanks for your work, I noticed that in this FLIP, event-time watermark is created and sent through a separate WatermarkGenerator. I would like to know if there is support for Source to send event-time watermark? Best, Junrui Xu Huang 于2025年1月6日周一 10:31写道： > Hi, Anil > > Maybe the water

Re: [DISCUSS] FLIP-500: Support Join Extension in DataStream V2 API

Hi Xu, Thanks for your work. I have a small question: In JoinExtension, when a record is received, is it immediately joined with all the data received from the other side, or does it wait until both streams are finished before joining? Also, does it work on both bounded and unbounded streams? Xu

Re: [DISCUSS] FLIP-467: Introduce Generalized Watermarks

Hi Xu Huang, Thanks for the proposal! I have a question: If I have a large number of generalized watermarks that need to be created, where should they be declared? Should they be declared only once in a single Source, or in all operators that need to send, receive, and process them? Best regards

Re: [VOTE] FLIP-467: Introduce Generalized Watermarks

+1 (binding) Best, Junrui Xintong Song 于2024年12月20日周五 17:49写道： > +1 (binding) > > Best, > > Xintong > > > > On Fri, Dec 20, 2024 at 3:53 PM Xu Huang wrote: > > > Hi, all. > > > > > > I'd like to start a vote on FLIP-467: Introduce Generalized Watermarks > [1]. > > > > You can find the discussi

Re: [VOTE] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

+1 (binding) Best, Junrui Yuepeng Pan 于2025年1月10日周五 10:05写道： > +1 non-binding > > Thanks for driving it ! > > > > Best, > Yuepeng Pan > > > > > > > > > 在 2025-01-10 09:57:20，"weijie guo" 写道： > >+1(binding) > > > >Best regards, > > > >Weijie > > > > > >Xu Huang 于2025年1月7日周二 22:49写道： > > > >> H

  1   2   >