Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to the Flink project

2019-07-18 Thread Zhu Zhu
Congratulations Becket! Xintong Song 于2019年7月18日周四 下午4:33写道: > Congratulations Becket! > > Thank you~ > > Xintong Song > > > > On Thu, Jul 18, 2019 at 4:20 PM Kurt Young wrote: > > > Congrats Becket! > > > > Best, > > Kurt > > > > > > On Thu, Jul 18, 2019 at 4:12 PM JingsongLee > .invalid> > >

Re: [ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-22 Thread Zhu Zhu
Congratulations Zhijiang! boshu Zheng 于2019年7月23日周二 上午9:46写道: > Congrats Zhijiang :) > On 07/23/2019 09:29, Dian Fu wrote: > Congrats Zhijiang! > > > 在 2019年7月23日,上午9:14,Kurt Young 写道: > > > > Congratulations Zhijiang! > > > > Best, > > Kurt > > > > > > On Tue, Jul 23, 2019 at 8:59 AM Biao Liu

Re: [DISCUSS] Allow at-most-once delivery in case of failures

2019-07-24 Thread Zhu Zhu
failover strategy. It can be helpful for scenarios with higher data consistency demands. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-1+%3A+Fine+Grained+Recovery+from+Task+Failures Thanks, Zhu Zhu Biao Liu 于2019年7月24日周三 上午10:41写道: > Hi Stephan & Xiaogang, > > It'

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Zhu Zhu
Congratulations to Hequn! Thanks, Zhu Zhu Zili Chen 于2019年8月7日周三 下午5:16写道: > Congrats Hequn! > > Best, > tison. > > > Jeff Zhang 于2019年8月7日周三 下午5:14写道: > >> Congrats Hequn! >> >> Paul Lam 于2019年8月7日周三 下午5:08写道: >> >>> Congrats Hequn! W

Re: Checkpointing under backpressure

2019-08-14 Thread Zhu Zhu
And I agree a slot with point 4 in Piotr's last mail and think it's necessary for a CP1 snapshotted task to process CP1 buffered data before all CP1 barriers are are received in this task. Otherwise it might be a processing performance regression compared to current exactly-once checkp

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-14 Thread Zhu Zhu
Congratulations Andrey! Thanks, Zhu Zhu vino yang 于2019年8月15日周四 上午11:05写道: > Congratulations Andrey! > > Best, > Vino > > Yun Gao 于2019年8月15日周四 上午10:49写道: > > > Congratulations An

Re: [DISCUSS] Reducing build times

2019-08-15 Thread Zhu Zhu
er it multiple times. With it we can postpone the testing of IT cases or connectors before the PR reaches a stable state. Thanks, Zhu Zhu Chesnay Schepler 于2019年8月15日周四 下午3:38写道: > Hello everyone, > > improving our build times is a hot topic at the moment so let's discuss >

Re: How to load udf jars in flink program

2019-08-15 Thread Zhu Zhu
Hi Jiangang, Does "flink run -j jarpath ..." work for you? If that jar id deployed to the same path on each worker machine, you can try "flink run -C classpath ..." as well. Thanks, Zhu Zhu 刘建刚 于2019年8月15日周四 下午5:31写道: > We are using per-job to load udf jar when

Re: CiBot Update

2019-08-22 Thread Zhu Zhu
Thanks Chesnay for the CI improvement! It is very helpful. Thanks, Zhu Zhu zhijiang 于2019年8月22日周四 下午4:18写道: > It is really very convenient now. Valuable work, Chesnay! > > Best, > Zhijiang > -- > From:Till Roh

Re: [DISCUSS] Enhance Support for Multicast Communication Pattern

2019-08-23 Thread Zhu Zhu
, which is hard to maintain and extend. Thanks, Zhu Zhu Yun Gao 于2019年8月22日周四 下午8:42写道: > Hi everyone, > In some scenarios we met a requirement that some operators want to > send records to theirs downstream operators with an multicast communication > pattern. In detail, for some

Re: [DISCUSS] Enhance Support for Multicast Communication Pattern

2019-08-23 Thread Zhu Zhu
lti-cast can help with this case. Thanks, Zhu Zhu Piotr Nowojski 于2019年8月23日周五 下午3:20写道: > Hi, > > Yun: > > Thanks for proposing the idea. I have checked the document and left couple > of questions there, but it might be better to answer them here. > > What is the exact mot

Re: [DISCUSS] Enhance Support for Multicast Communication Pattern

2019-08-23 Thread Zhu Zhu
Hi Piotr, Yes you are right it's a distributed cross join requirement. Broadcast join can help with cross join cases. But users cannot use it if the data set to join is too large to fit into one subtask. Sorry for left some details behind. Thanks, Zhu Zhu Piotr Nowojski 于2019年8月23日周五 下午4

Re: [DISCUSS] Enhance Support for Multicast Communication Pattern

2019-08-23 Thread Zhu Zhu
a commonly known scenario, I think users can benefit from cross join sooner or later. Thanks, Zhu Zhu Piotr Nowojski 于2019年8月23日周五 下午6:19写道: > Hi, > > Thanks for the answers :) Ok I understand the full picture now. +1 from my > side on solving this issue somehow. But before we start dis

Re: [DISCUSS] Enhance Support for Multicast Communication Pattern

2019-08-24 Thread Zhu Zhu
Hi Piotr, Thanks for the explanation. Agreed that the broadcastEmit(record) is a better choice for broadcasting for the iterations. As broadcasting for the iterations is the first motivation, let's support it first. Thanks, Zhu Zhu Yun Gao 于2019年8月23日周五 下午11:56写道: >

Re: [DISCUSS] Use Java's Duration instead of Flink's Time

2019-08-24 Thread Zhu Zhu
+1 since Java Duration is more common and powerful than Flink Time. For whether to drop scala Duration for parsing duration OptionConfig, I think it's another question and should be discussed in another thread. Thanks, Zhu Zhu Becket Qin 于2019年8月24日周六 下午4:16写道: > +1, makes sense.

Re: How to handle Flink Job with 400MB+ Uberjar with 800+ containers ?

2019-08-30 Thread Zhu Zhu
One optimization that we take is letting yarn to reuse the flink-dist jar which was localized when running previous jobs. Thanks, Zhu Zhu Jörn Franke 于2019年8月30日周五 下午4:02写道: > Increase replication factor and/or use HDFS cache > https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/

Re: [SURVEY] Is the default restart delay of 0s causing problems?

2019-08-30 Thread Zhu Zhu
In our production, we usually override the restart delay to be 10 s. We once encountered cases that external services are overwhelmed by reconnections from frequent restarted tasks. As a safer though not optimized option, a default delay larger than 0 s is better in my opinion. 未来阳光 <2217232...@q

Re: How to handle Flink Job with 400MB+ Uberjar with 800+ containers ?

2019-09-01 Thread Zhu Zhu
ed cache of YARN. In this way, the localized dist jar can be shared by different YARN applications and it will not be removed when the YARN application which localized it terminates. This requires some changes in Flink though. We will open a ISSUE to contribute this optimization to the community. Thank

Re: [DISCUSS] Simplify Flink's cluster level RestartStrategy configuration

2019-09-01 Thread Zhu Zhu
he default restart delay of 0s causing problems) is ongoing and we may need to take the result from that. Thanks, Zhu Zhu Becket Qin 于2019年9月2日周一 上午9:06写道: > +1. The new behavior makes sense to me. > > BTW, we need a FLIP for this :) > > On Fri, Aug 30, 2019 at 10:17 PM Till Rohrman

Re: [DISCUSS] FLIP-53: Fine Grained Resource Management

2019-09-02 Thread Zhu Zhu
should be *StreamingJobGraphGenerator*, as *StreamGraphGenerator* is not aware of JobGraph and pipelined region. Thanks, Zhu Zhu Xintong Song 于2019年9月2日周一 上午11:59写道: > Updated the FLIP wiki page [1], with the following changes. > >- Remove the step of converting pipelined edges between differen

Re: [SURVEY] Is the default restart delay of 0s causing problems?

2019-09-02 Thread Zhu Zhu
1s looks good to me. And I think the conclusion that when a user should override the delay is worth to be documented. Thanks, Zhu Zhu Steven Wu 于2019年9月3日周二 上午4:42写道: > 1s sounds a good tradeoff to me. > > On Mon, Sep 2, 2019 at 1:30 PM Till Rohrmann wrote: > >> Thanks

Re: [DISCUSS] FLIP-53: Fine Grained Resource Management

2019-09-03 Thread Zhu Zhu
Thanks Xintong for the explanation. For question #1, I think it's good as long as DataSet job behaviors remains the same. For question #2, agreed that the resource difference is small enough(at most 1 edge diff) in current supported point-wise execution edge connection patterns. Thanks, Zh

Re: [VOTE] FLIP-61 Simplify Flink's cluster level RestartStrategy configuration

2019-09-04 Thread Zhu Zhu
+1 (non-binding) Thanks, Zhu Zhu Till Rohrmann 于2019年9月4日周三 下午5:05写道: > Hi everyone, > > I would like to start the voting process for FLIP-61 [1], which is > discussed and reached consensus in this thread [2]. > > Since the change is rather small I'd like to shorten th

Re: [VOTE] FLIP-62: Set default restart delay for FixedDelay- and FailureRateRestartStrategy to 1s

2019-09-04 Thread Zhu Zhu
+1 (non-binding) Thanks, Zhu Zhu Till Rohrmann 于2019年9月4日周三 下午5:06写道: > Hi everyone, > > I would like to start the voting process for FLIP-62 [1], which > is discussed and reached consensus in this thread [2]. > > Since the change is rather small I'd like to shorten th

Re: [VOTE] FLIP-53: Fine Grained Operator Resource Management

2019-09-06 Thread Zhu Zhu
Thanks Xintong for proposing this better resource management. This helps a lot to users who want to better manage the job resources. And would be even more useful if in the future we can have auto-tuning mechanism for jobs. +1 (non-binding) Thanks, Zhu Zhu Xintong Song 于2019年9月6日周五 上午11:17写道

Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC

2019-09-06 Thread Zhu Zhu
Congratulations Kostas! Thanks, Zhu Zhu Yu Li 于2019年9月6日周五 下午10:49写道: > Congratulations Klou! > > Best Regards, > Yu > > > On Fri, 6 Sep 2019 at 22:43, Forward Xu wrote: > > > Congratulations Kloudas! > > > > > > Best, > > > &

Re: Checkpointing clarification

2019-09-06 Thread Zhu Zhu
state. Thanks, Zhu Zhu Dian Fu 于2019年9月6日周五 下午8:17写道: > When a WindowOperator receives all the barrier from the upstream, it will > forward the barrier to downstream operator and perform the checkpoint > asynchronously. > It doesn't have to wait the window to trigger befor

Re: [DISCUSS] Features for Apache Flink 1.10

2019-09-06 Thread Zhu Zhu
Thanks Gary for kicking off this discussion. Really appreciate that you and Yu offer to help to manage 1.10 release. +1 for Gary and Yu as release managers. Thanks, Zhu Zhu Dian Fu 于2019年9月7日周六 下午12:26写道: > Hi Gary, > > Thanks for kicking off the release schedule of 1.10. +1 for you

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

2019-09-11 Thread Zhu Zhu
Congratulations Zili! Thanks, Zhu Zhu Terry Wang 于2019年9月11日周三 下午5:34写道: > Congratulations! > > Best, > Terry Wang > > > > 在 2019年9月11日,下午5:28,Dian Fu 写道: > > Congratulations! > > 在 2019年9月11日,下午5:26,Jeff Zhang 写道: > > Congratulations Zili Che

[SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Zhu Zhu
hanks, Zhu Zhu

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-12 Thread Zhu Zhu
estart-strategy: org.foobar.MyRestartStrategyFactoryFactory". The usage of restart strategies you mentioned will keep working with the new scheduler. Thanks, Zhu Zhu Oytun Tez 于2019年9月12日周四 下午10:05写道: > Hi Zhu, > > We are using custom restart strategy like this: > > environment.setRestartStrategy(f

Re: [VOTE] FLIP-287: Extend Sink#InitContext to expose TypeSerializer, ObjectReuse and JobID

2023-06-18 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Tzu-Li (Gordon) Tai 于2023年6月17日周六 11:32写道: > > +1 (binding) > > On Fri, Jun 16, 2023, 09:53 Jing Ge wrote: > > > +1(binding) > > > > Best Regards, > > Jing > > > > On Fri, Jun 16, 2023 at 10:10 AM Lijie Wang > > wrote: > > > > > +1 (binding) > > > > > > Thanks for driv

Re: [VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-24 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Rui Fan <1996fan...@gmail.com> 于2023年6月24日周六 12:28写道: > > +1(binding), thanks for driving this improvement. > > Best, > Rui Fan > > On Sat, Jun 24, 2023 at 4:55 AM Jing Ge wrote: > > > +1(binding) > > > > Best Regards, > > Jing > > > > On Fri, Jun 23, 2023 at 5:50 PM Lij

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-06-27 Thread Zhu Zhu
Thanks Dong and Yunfeng for creating this FLIP and driving this discussion. The new design looks generally good to me. Increasing the checkpoint interval when the job is processing backlogs is easier for users to understand and can help in more scenarios. I have one comment about the new configur

Re: [VOTE] FLIP-321: introduce an API deprecation process

2023-07-03 Thread Zhu Zhu
+1 (binding) Thanks, Zhu ConradJam 于2023年7月3日周一 22:39写道: > > +1 (no-binding) > > Matthias Pohl 于2023年7月3日周一 22:33写道: > > > Thanks, Becket > > > > +1 (binding) > > > > On Mon, Jul 3, 2023 at 10:44 AM Jing Ge > > wrote: > > > > > +1(binding) > > > > > > On Mon, Jul 3, 2023 at 10:19 AM Stefan Ric

Re: Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-03 Thread Zhu Zhu
Congratulations everyone! Thanks, Zhu Hang Ruan 于2023年7月4日周二 14:06写道: > > Congratulations! > > Best, > Hang > > Jingsong Li 于2023年7月4日周二 13:47写道: > > > Congratulations! > > > > Thank you! All of the Flink community! > > > > Best, > > Jingsong > > > > On Tue, Jul 4, 2023 at 1:24 PM tison wrote:

Re: [DISCUSS] Release 2.0 Work Items

2023-07-10 Thread Zhu Zhu
Agreed that we should deprecate affected APIs as soon as possible. But there is not much time before the feature freeze of 1.18, hence I'm a bit concerned that some of the deprecations might not be done 1.18. We are currently looking into the improvements of the configuration layer. Most of the p

Re: [DISCUSS][2.0] FLIP-340: Remove rescale REST endpoint

2023-07-18 Thread Zhu Zhu
+1 Thanks, Zhu Jing Ge 于2023年7月18日周二 19:09写道: > > +1 > > On Tue, Jul 18, 2023 at 1:05 PM Maximilian Michels wrote: > > > +1 > > > > On Tue, Jul 18, 2023 at 12:29 PM Gyula Fóra wrote: > > > > > > +1 > > > > > > On Tue, 18 Jul 2023 at 12:12, Xintong Song > > wrote: > > > > > > > +1 > > > > > >

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

2023-07-19 Thread Zhu Zhu
+1 (binding) Thanks, Zhu yuxia 于2023年7月20日周四 09:23写道: > > +1(binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Guowei Ma" > 收件人: "dev" > 发送时间: 星期三, 2023年 7 月 19日 下午 1:54:52 > 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when > source is processing backlog

Re: [VOTE][2.0] FLIP-340: Remove rescale REST endpoint

2023-07-24 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Xintong Song 于2023年7月25日周二 09:46写道: > > +1 (binding) > > Best, > > Xintong > > > > On Mon, Jul 24, 2023 at 11:58 PM Jing Ge wrote: > > > +1 > > > > On Mon, Jul 24, 2023 at 11:43 PM Chesnay Schepler > > wrote: > > > > > I update the endpoint in the FLIP. > > > > > > On

Re: [VOTE][2.0] FLIP-336: Remove "now" timestamp field from REST responses

2023-07-25 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Xintong Song 于2023年7月25日周二 09:46写道: > > +1 (binding) > > Best, > > Xintong > > > > On Mon, Jul 24, 2023 at 11:26 PM Jing Ge wrote: > > > +1(binding) > > > > On Mon, Jul 24, 2023 at 8:55 PM Matthias Pohl > > wrote: > > > > > +1 (binding) > > > > > > On Mon, Jul 24, 2023

Re: [VOTE] Release 2.0 must-have work items - Round 2

2023-07-26 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Leonard Xu 于2023年7月26日周三 15:40写道: > > Thanks @xingtong for driving the work. > > +1(binding) > > Best, > Leonard > > > On Jul 26, 2023, at 3:18 PM, Konstantin Knauf > > wrote: > > > > Hi Xingtong, > > > > yes, I am fine with the conclusion for SourceFunction. I chatted

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-09-27 Thread Zhu Zhu
ined resources. The proposed config option `slot.request.max-interval` then can be renamed to `taskmanager.load-balance.request-stablizing-timeout` to show its relation with the feature. The proposed `slot.sharing-strategy` is not needed, because the configured "Tasks" mode will do the wor

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-10-09 Thread Zhu Zhu
> example 2 of section 2.2.3 can be resolved. Do I understand it > >> >> > > > correctly? > >> >> > > > >> >> > > The example assigned result is the final allocation result when > flink > >> >> > > us

Re: [DISCUSS] FLIP-370 : Support Balanced Tasks Scheduling

2023-10-10 Thread Zhu Zhu
gic of 'Slots' > and > 'Tasks' are exactly the same, it feels a bit strange to define two > enumerations. > And it may cause confusion to users. > > If they are totally the same, how about combining them to SlotsAndTasks? > It can be compatible with '

Re: [VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-16 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Jane Chan 于2023年10月13日周五 17:00写道: > +1 (non-binding) > > Best, > Jane > > On Fri, Oct 13, 2023 at 11:20 AM Yuxin Tan wrote: > > > +1(non-binding) > > > > Best, > > Yuxin > > > > > > Zhanghao Chen 于2023年10月13日周五 10:54写道: > > > > > +1 (non-binding) > > > > > > Best, > >

Re: [VOTE] FLIP-370: Support Balanced Tasks Scheduling

2023-10-25 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Yuepeng Pan 于2023年10月25日周三 11:32写道: > +1 (non-binding) > > Regards, > Yuepeng Pan > > On 2023/10/23 08:25:30 xiangyu feng wrote: > > Thanks for driving that. > > +1 (non-binding) > > > > Regards, > > Xiangyu > > > > Yu Chen 于2023年10月23日周一 15:19写道: > > > > > +1 (non-bin

Re: [DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-10-31 Thread Zhu Zhu
1] document for more details about the > proposed design and implementation. > > I also thank Zhu Zhu and LiJie Wang for their suggestions during the > pre-discussion. > Looking forward to your feedback and suggestions, thanks. > > [1] > > https://cwiki.apache.org/confluence

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-02 Thread Zhu Zhu
Thanks Junrui for creating the FLIP and kicking off this discussion. The community has been constantly striving to unify and simplify the configuration layer of Flink. Some progress has already been made, such as FLINK-29379. However, the compatibility of public interfaces poses an obstacle to com

Re: [VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-12 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Xia Sun 于2023年11月13日周一 15:02写道: > +1 (non-binding) > > Best, > Xia > > Samrat Deb 于2023年11月13日周一 12:37写道: > > > +1 (non binding) > > > > Bests, > > Samrat > > > > On Mon, 13 Nov 2023 at 9:10 AM, Yangze Guo wrote: > > > > > +1 (binding) > > > > > > Best, > > > Yangze G

Re: [DISCUSS] FLIP-364: Improve the restart-strategy

2023-11-13 Thread Zhu Zhu
s some issues: > >> > > 1. The exponential-delay doesn't have the max attempts mechanism, > >> > > it means that flink will restart indefinitely even if it fails > >> frequently. > >> > > 2. For multi-region streaming jobs and all batch jobs, the failure > o

Re: [DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-15 Thread Zhu Zhu
Thanks Junrui for creating the FLIP and kicking off this discussion. Exposing a mutable ExecutionConfig which is even shared by multiple operators is truly a defect which can result in weird results. +1 Thanks, Zhu Junrui Lee 于2023年11月15日周三 16:53写道: > Hi all, > > I'd like to start a discussio

Re: [VOTE] Release flink-shaded 16.2, release candidate #1

2023-11-16 Thread Zhu Zhu
+1 (binding) - verified checksum and signature - verified the source archive does not contain any binary - built from source code successfully - checked the web pr Thanks, Zhu Xintong Song 于2023年11月15日周三 10:42写道: > +1 (binding) > > - verified checksum and signature > - verified license and not

Re: [VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-27 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Rui Fan <1996fan...@gmail.com> 于2023年11月28日周二 13:11写道: > +1(binding) > > Best, > Rui > > On Tue, Nov 28, 2023 at 12:34 PM Junrui Lee wrote: > > > Hi everyone, > > > > Thank you to everyone for the feedback on FLIP-391: Deprecate > > RuntimeContext#getExecutionConfig[1]

Re: [VOTE] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-29 Thread Zhu Zhu
+1 Thanks, Zhu Xia Sun 于2023年11月30日周四 11:41写道: > Hi everyone, > > I'd like to start a vote on FLIP-379: Dynamic source parallelism inference > for batch jobs[1] which has been discussed in this thread [2]. > > The vote will be open for at least 72 hours unless there is an objection or > not eno

Re: [VOTE] FLIP-364: Improve the restart-strategy

2023-11-30 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Zhanghao Chen 于2023年11月30日周四 23:31写道: > +1 (non-binding) > > Best, > Zhanghao Chen > > From: Rui Fan <1996fan...@gmail.com> > Sent: Monday, November 13, 2023 11:01 > To: dev > Subject: [VOTE] FLIP-364: Improve the restart-strategy > > H

Re: [DISCUSS] FLIP-398: Improve Serialization Configuration And Usage In Flink

2023-12-11 Thread Zhu Zhu
Thanks Yong for creating the FLIP and starting the discussion. Having a unified config option for all kinds of serializers can make it much easier for users to set, track and maintain the serializers for jobs. +1 Thanks, Zhu weijie guo 于2023年12月12日周二 14:01写道: > Thanks for driving this, Yong.

Re: [VOTE] FLIP-335: Deprecation and removal of Flink's Time classes in favor of Java's Duration

2023-12-12 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Matthias Pohl 于2023年12月12日周二 01:32写道: > Hi everyone, > I'd like to start a vote on FLIP-335 [1]. It covers the deprecation (and > Flink 2.0-related removal) of Flink's Time classes in favor of Java's > Duration class. > > The related discussion thread can be found in [2

Re: [DISCUSS] Should Configuration support getting value based on String key?

2023-12-13 Thread Zhu Zhu
parse the config? Pre-defined ConfigOptions are better for configuration maintenance, compared to arbitrary strings Thanks, Zhu Rui Fan <1996fan...@gmail.com> 于2023年12月13日周三 19:27写道: > Thanks Martijn for the quick clarification! > > I see Zhu Zhu and Junrui Lee are working on configur

Re: [VOTE] FLIP-383: Support Job Recovery for Batch Jobs

2023-12-14 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Xintong Song 于2023年12月14日周四 15:36写道: > +1 (binding) > > Best, > > Xintong > > > > On Thu, Dec 14, 2023 at 3:15 PM Lijie Wang > wrote: > > > Hi devs, Thanks for all feedback about the FLIP-383: Support Job Recovery > > for Batch Jobs[1]. This FLIP was discussed in [2].

Re: [DISCUSS] Should Configuration support getting value based on String key?

2023-12-14 Thread Zhu Zhu
gt; >> most > >>>>>> effective way is to not allow accessing a specific option with a > >>>>>> string-key, so that developers not awaring of this discussion won't > >>>>>> accidentally use it. On the other hand, case-2 is a m

Re: [VOTE] FLIP-364: Update the default value of backoff-multiplier from 1.2 to 1.5

2023-12-19 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Rui Fan <1996fan...@gmail.com> 于2023年12月19日周二 17:17写道: > Hi everyone, > > Thank you to everyone for the feedback on FLIP-364: > Improve the restart-strategy[1] which has been voted in this thread[2]. > > After the vote on FLIP-364, there was some feedback on the user mai

Re: [VOTE] FLIP-398: Improve Serialization Configuration And Usage In Flink

2023-12-27 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Zhanghao Chen 于2023年12月27日周三 15:41写道: > +1 (non-binding) > > Best, > Zhanghao Chen > > From: Yong Fang > Sent: Wednesday, December 27, 2023 14:54 > To: dev > Subject: [VOTE] FLIP-398: Improve Serialization Configuration And Usage In >

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2024-01-08 Thread Zhu Zhu
Thanks for creating the FLIP and starting the discussion, Yangze. It makes sense to me to improve the job submission performance in OLAP scenarios. I have a few questions regarding the proposed changes: 1. How about skipping the job graph persistence if the proposed config 'high-availability.enab

Re: [DISCUSS] FLIP-403: High Availability Services for OLAP Scenarios

2024-01-09 Thread Zhu Zhu
age except for the job graph store. > > WDYT? > > [1] > https://issues.apache.org/jira/browse/FLINK-31816?focusedCommentId=17741054&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17741054 > > Best, > Yangze Guo > > On Mon, Jan 8, 2024 a

Re: Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-11 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Hangxiang Yu 于2024年1月11日周四 14:26写道: > +1 (non-binding) > > On Thu, Jan 11, 2024 at 11:19 AM Xuannan Su wrote: > > > +1 (non-binding) > > > > Best, > > Xuannan > > > > On Thu, Jan 11, 2024 at 10:28 AM Xuyang wrote: > > > > > > +1 (non-binding)-- > > > > > > Best! >

Re: [VOTE] FLIP-405: Migrate string configuration key to ConfigOption

2024-01-11 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Xuannan Su 于2024年1月12日周五 14:24写道: > Hi all, > > I would like to clarify the statement regarding the first improvement > from the previous email, as it was incomplete. To be more specific, we > will also deprecate the getClass(String key, Class > defaultValue, ClassLoade

Re: [VOTE] Release 1.10.0, release candidate #3

2020-02-09 Thread Zhu Zhu
The commit info is shown as on the web UI and in logs. Not sure if it's a common issue or just happens to my build only. Thanks, Zhu Zhu aihua li 于2020年2月9日周日 下午7:42写道: > Yes, but the results you see in the Performance Code Speed Center [3] skip > FLIP-49. > The results

Re: [VOTE] Release 1.10.0, release candidate #3

2020-02-09 Thread Zhu Zhu
elism=1000 on yarn cluster, with the new scheduler and legacy scheduler, the job runs well (tuned some resource configs to enable the jobs to work well) * killed TMs to trigger failures, the jobs can finally recover from the failures Thanks, Zhu Zhu Zhu Zhu 于2020年2月10日周一 上午12:31写道: > The c

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-13 Thread Zhu Zhu
as well as the git tag - checked the website pull request Thanks, Zhu Zhu Ufuk Celebi 于2020年2月14日周五 上午12:32写道: > PS: Also verified the NOTICE changes since the last RC. > > On Thu, Feb 13, 2020 at 5:25 PM Ufuk Celebi wrote: > > > Hey Chensay, > > > > +1 (binding).

Re: [ANNOUNCE] Apache Flink-shaded 10.0 released

2020-02-19 Thread Zhu Zhu
Thanks Chesnay for the great work and everyone who helps with the improvements and release! Thanks, Zhu Zhu Dian Fu 于2020年2月20日周四 上午9:44写道: > Thanks Chesnay for the great work and everyone involved! > > Regards, > Dian > > > 在 2020年2月20日,上午12:21,Zhijiang 写道: > > &g

Re: [DISCUSS] Kicking off the 1.11 release cycle

2020-02-20 Thread Zhu Zhu
Thanks Piotr and Zhijiang for volunteering as the release managers! +1 for aiming with the feature freeze date for end of April. Thanks, Zhu Zhu Piotr Nowojski 于2020年2月20日周四 下午4:26写道: > Hi, > > Thank you for giving me and Zhijiang opportunity and entrusting us with > the release :

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-23 Thread Zhu Zhu
Congratulations Jingsong! Thanks, Zhu Zhu Fabian Hueske 于2020年2月22日周六 上午1:30写道: > Congrats Jingsong! > > Cheers, Fabian > > Am Fr., 21. Feb. 2020 um 17:49 Uhr schrieb Rong Rong >: > > > Congratulations Jingsong!! > > > > Cheers, > > Rong > >

Re: [VOTE] FLIP-103: Better TM/JM Log Display

2020-02-23 Thread Zhu Zhu
+1 (binding) It can be very helpful to check GC state when GC logging is enabled. Thanks, Zhu Zhu zhenya Sun 于2020年2月24日周一 下午3:51写道: > 1 > > > able-sun > > > On 02/24/2020 15:45,jincheng sun wrote: > +1(binding) Thank you for driving this Yadong! > > Best, >

Re: [DISCUSS] FLIP-119: Pipelined Region Scheduling

2020-03-26 Thread Zhu Zhu
Thanks for reporting this Yangze. I have update the permission to those images. Everyone are able to view them now. Thanks, Zhu Zhu Yangze Guo 于2020年3月27日周五 上午11:25写道: > Thanks for driving this discussion, Zhu Zhu & Gary. > > I found that the image link in this FLIP is not working

Re: [DISCUSS] FLIP-119: Pipelined Region Scheduling

2020-03-27 Thread Zhu Zhu
pe of the FLIP. But we are moving forward to a more extensible scheduler (FLINK-10429) and resource aware scheduling (FLINK-10407). So I think it's possible we can have a scheduler in the future which dynamically changes the shuffle type wisely regarding available resources. Thanks, Zhu Z

Re: [DISCUSS] FLIP-119: Pipelined Region Scheduling

2020-03-29 Thread Zhu Zhu
nding requests right after the requests are sent to TM without confirming wether the slot offers succeed). We can look deeper into it later when we are about to support variant sizes slots. Thanks, Zhu Zhu Till Rohrmann 于2020年3月27日周五 下午10:59写道: > Thanks for creating this FLIP Zhu Zhu and Gary! &

Re: [DISCUSS] FLIP-119: Pipelined Region Scheduling

2020-03-30 Thread Zhu Zhu
Thanks for the nice suggestion Till. The section 'Bulk Slot Allocation' is updated. Thanks, Zhu Zhu Gary Yao 于2020年3月30日周一 下午3:38写道: > > > > The links work for me now. Someone might have fixed them. Never mind. > > > > Actually, I fixed the links after seein

Re: [DISCUSS] FLIP-118: Improve Flink’s ID system

2020-03-31 Thread Zhu Zhu
should not be a problem in most cases but might be a problem for large scale jobs. Shall we have an benchmark for it? Thanks, Zhu Zhu Yangze Guo 于2020年3月31日周二 下午2:19写道: > Thank you all for the feedback! Sorry for the belated reply. > > @Till > I'm +1 for your two ideas and I

Re: [DISCUSS] FLIP-118: Improve Flink’s ID system

2020-03-31 Thread Zhu Zhu
can be also composed of a JobID and an index as Till proposed. Thanks, Zhu Zhu Till Rohrmann 于2020年3月31日周二 下午8:36写道: > For the IntermediateDataSetID I was just thinking that it might actually be > interesting to know which job produced the result which, by using cluster > partitions

Re: [ANNOUNCE] New Committers and PMC member

2020-04-01 Thread Zhu Zhu
Congratulations Konstantin, Dawid and Zhijiang! Thanks, Zhu Zhu Piotr Nowojski 于2020年4月1日周三 下午7:18写道: > Congratulations :) > > > On 1 Apr 2020, at 13:05, Canbin Zheng wrote: > > > > Congratulations to all of you! > > > > Regards, > > Canbin Z

Re: [VOTE] FLIP-119: Pipelined Region Scheduling

2020-04-03 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Zhu Kurt Young 于2020年4月3日周五 下午5:25写道: > +1 (binding) > > Best, > Kurt > > > On Fri, Apr 3, 2020 at 4:02 PM Yangze Guo wrote: > > > +1 (non-binding) > > > > Best, > > Yangze Guo > > > > On Fri, Apr 3, 2020 a

Re: [ANNOUNCE] New Flink committer: Seth Wiesman

2020-04-06 Thread Zhu Zhu
Congratulations, Seth! Thanks, Zhu Zhu Dian Fu 于2020年4月7日周二 下午2:43写道: > Congratulations! > > > 在 2020年4月7日,下午2:35,Konstantin Knauf 写道: > > > > Congratulations, Seth! Well deserved :) > > > > On Tue, Apr 7, 2020 at 8:33 AM Tzu-Li (Gordon) Tai > >

Re: [DISCUSS] FLIP-118: Improve Flink’s ID system

2020-04-14 Thread Zhu Zhu
ultPartitionIDs can share the same IntermediateDataSetID, in this way the space of IntermediateResultPartitionID is a ref (to IntermediateDataSetID) and an int (index), which is smaller than 2 Longs (AbstractID). Thanks, Zhu Zhu Yangze Guo 于2020年4月14日周二 下午3:09写道: > Hi everyone, > > I&#x

Re: [VOTE] FLIP-118: Improve Flink’s ID system

2020-04-16 Thread Zhu Zhu
Thanks for proposing this improvement, Yangze. +1 (binding) Thanks, Zhu Zhu Zhijiang 于2020年4月17日周五 下午12:36写道: > Thanks for this FLIP, Yangze. > > Sorry for not involving in the previous discussion. In general I like the > proposed direction to make related IDs have more rich inf

Re: [ANNOUNCE] New Apache Flink PMC Member - Hequn Chen

2020-04-20 Thread Zhu Zhu
Congratulations Hequn! Thanks, Zhu Zhu zoudan 于2020年4月20日周一 上午10:34写道: > Congratulations Hequn > > Best, > Dan Zou > > > > 在 2020年4月20日,10:23,Terry Wang 写道: > > > > Congratulations Hequn !!! > > Best, > > Terry Wang > > > > > >

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-22 Thread Zhu Zhu
+1 (non-binding) - checked release notes - checked signatures - built from source - submitted an example job on yarn cluster - WebUI and logs look good Thanks, Zhu Zhu Yu Li 于2020年4月22日周三 下午2:55写道: > +1 (non-binding) > > - Checked release notes: OK > - Checked sums and si

Re: [DISCUSS] Exact feature freeze date

2020-04-23 Thread Zhu Zhu
+1 for extending the code freeze date. FLIP-119 could benefit from it. May 15th sounds reasonable. Thanks, Zhu Zhu Jark Wu 于2020年4月24日周五 上午12:01写道: > +1 > > Thanks, > Jark > > On Thu, 23 Apr 2020 at 22:36, Xintong Song wrote: > > > +1 > > From our side we ca

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-19 Thread Zhu Zhu
Flink 1.10 Other usages are still supported, including all the strategies and configuring ways described in https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/task_failure_recovery.html#restart-strategies . Feel free to share in this thread if you has any concern for it. Thanks, Zh

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-19 Thread Zhu Zhu
Thanks Steven for the feedback! Could you share more information about the metrics you add in you customized restart strategy? Thanks, Zhu Zhu Steven Wu 于2019年9月20日周五 上午7:11写道: > We do use config like "restart-strategy: > org.foobar.MyRestartStrategyFactoryFactory". Mainly t

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-22 Thread Zhu Zhu
not be restarted when task failures happen and the "fullRestart" value will not increment in such cases. I'd appreciate if you can help with these questions and we can make better decisions for Flink. Thanks, Zhu Zhu Steven Wu 于2019年9月22日周日 上午3:31写道: > Zhu Zhu, > > Flink fullRes

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-23 Thread Zhu Zhu
ric to show failovers that respects fine grained recovery. [1] https://issues.apache.org/jira/browse/FLINK-14164 Thanks, Zhu Zhu Steven Wu 于2019年9月24日周二 上午6:41写道: > > When we setup alert like "fullRestarts > 1" for some rolling window, we > want to use counter. if it i

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-24 Thread Zhu Zhu
Hi Steven, As a conclusion, since we will have a meter metric[1] for restarts, customized restart strategy is not needed in your case. Is that right? [1] https://issues.apache.org/jira/browse/FLINK-14164 Thanks, Zhu Zhu Steven Wu 于2019年9月25日周三 上午2:30写道: > Zhu Zhu, > > Sorry, I

Re: [SURVEY] How many people are using customized RestartStrategy(s)

2019-09-25 Thread Zhu Zhu
We will then keep the decision that we do not support customized restart strategy in Flink 1.10. Thanks Steven for the inputs! Thanks, Zhu Zhu Steven Wu 于2019年9月26日周四 上午12:13写道: > Zhu Zhu, that is correct. > > On Tue, Sep 24, 2019 at 8:04 PM Zhu Zhu wrote: > >> Hi

Re: [NOTICE] Binary licensing is now auto-generated

2019-10-18 Thread Zhu Zhu
Thanks Chesnay for this improvement! vino yang 于2019年10月18日周五 上午10:29写道: > Thanks Chesnay! Great job! > > Best, > Vino > > Jark Wu 于2019年10月18日周五 上午9:51写道: > > > Thanks Chesnay! This is really a great job! > > > > Best, > > Jark > > > > > 在 2019年10月17日,22:03,未来阳光 <2217232...@qq.com> 写道: > > > >

Re: [SURVEY] Dropping non Credit-based Flow Control

2019-10-19 Thread Zhu Zhu
+1 to drop the non credit-based flow control. We have turned to credit-based flow control for long in production. It has been good for all our cases. The non credit-based flow control code has been a burden when we are trying to change the network stack code for new features. Thanks, Zhu Zhu

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

2019-10-20 Thread Zhu Zhu
ecome available, especially for a sequence of short lived jobs. This however introduces JM dependency on RM on job finishes, which is unwanted. Thanks, Zhu Zhu Chesnay Schepler 于2019年10月15日周二 下午6:48写道: > I have updated the FLIP. > > - adopted job-/cluster partitions naming scheme > - ou

Re: [DISCUSS] FLIP-67: Global partitions lifecycle

2019-10-20 Thread Zhu Zhu
Thanks Till for the explanation! That looks good to me. Thanks, Zhu Zhu Till Rohrmann 于2019年10月21日周一 上午2:45写道: > Hi Zhu Zhu, > > the cluster partition does not need to be registered at the RM before it > can be used. The cluster partition descriptor will be reported to the > cl

Re: [VOTE] FLINK-67: Cluster partition life-cycle

2019-10-20 Thread Zhu Zhu
Thanks Chesnay for proposing this improvement! It's meaningful for interactive query and the design looks good. +1 (non-binding) Thanks, Zhu Zhu Till Rohrmann 于2019年10月17日周四 下午8:48写道: > Thanks for creating this FLIP and starting the VOTE for it. > > +1 (binding) > > Cheer

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-22 Thread Zhu Zhu
+1 (non-binding) Thanks, Zhu Zhu Biao Liu 于2019年10月22日周二 上午11:06写道: > +1 (non-binding) > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Tue, 22 Oct 2019 at 10:26, Jark Wu wrote: > > > +1 (non-binding) > > > > Best, > > Jark > > > >

  1   2   3   4   5   >