Congratulations Becket!
Xintong Song 于2019年7月18日周四 下午4:33写道:
> Congratulations Becket!
>
> Thank you~
>
> Xintong Song
>
>
>
> On Thu, Jul 18, 2019 at 4:20 PM Kurt Young wrote:
>
> > Congrats Becket!
> >
> > Best,
> > Kurt
> >
> >
> > On Thu, Jul 18, 2019 at 4:12 PM JingsongLee > .invalid>
> >
Congratulations Zhijiang!
boshu Zheng 于2019年7月23日周二 上午9:46写道:
> Congrats Zhijiang :)
> On 07/23/2019 09:29, Dian Fu wrote:
> Congrats Zhijiang!
>
> > 在 2019年7月23日,上午9:14,Kurt Young 写道:
> >
> > Congratulations Zhijiang!
> >
> > Best,
> > Kurt
> >
> >
> > On Tue, Jul 23, 2019 at 8:59 AM Biao Liu
failover strategy. It can be helpful for scenarios
with higher data consistency demands.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-1+%3A+Fine+Grained+Recovery+from+Task+Failures
Thanks,
Zhu Zhu
Biao Liu 于2019年7月24日周三 上午10:41写道:
> Hi Stephan & Xiaogang,
>
> It'
Congratulations to Hequn!
Thanks,
Zhu Zhu
Zili Chen 于2019年8月7日周三 下午5:16写道:
> Congrats Hequn!
>
> Best,
> tison.
>
>
> Jeff Zhang 于2019年8月7日周三 下午5:14写道:
>
>> Congrats Hequn!
>>
>> Paul Lam 于2019年8月7日周三 下午5:08写道:
>>
>>> Congrats Hequn! W
And I agree a slot with point 4 in Piotr's last mail and think it's
necessary for a CP1 snapshotted task to process CP1 buffered data before
all CP1 barriers are are received in this task.
Otherwise it might be a processing performance regression compared to
current exactly-once checkp
Congratulations Andrey!
Thanks,
Zhu Zhu
vino yang 于2019年8月15日周四 上午11:05写道:
> Congratulations Andrey!
>
> Best,
> Vino
>
> Yun Gao 于2019年8月15日周四 上午10:49写道:
>
> > Congratulations An
er it multiple times.
With it we can postpone the testing of IT cases or connectors before the PR
reaches a stable state.
Thanks,
Zhu Zhu
Chesnay Schepler 于2019年8月15日周四 下午3:38写道:
> Hello everyone,
>
> improving our build times is a hot topic at the moment so let's discuss
>
Hi Jiangang,
Does "flink run -j jarpath ..." work for you?
If that jar id deployed to the same path on each worker machine, you can
try "flink run -C classpath ..." as well.
Thanks,
Zhu Zhu
刘建刚 于2019年8月15日周四 下午5:31写道:
> We are using per-job to load udf jar when
Thanks Chesnay for the CI improvement!
It is very helpful.
Thanks,
Zhu Zhu
zhijiang 于2019年8月22日周四 下午4:18写道:
> It is really very convenient now. Valuable work, Chesnay!
>
> Best,
> Zhijiang
> --
> From:Till Roh
, which is hard to maintain and extend.
Thanks,
Zhu Zhu
Yun Gao 于2019年8月22日周四 下午8:42写道:
> Hi everyone,
> In some scenarios we met a requirement that some operators want to
> send records to theirs downstream operators with an multicast communication
> pattern. In detail, for some
lti-cast can help with this case.
Thanks,
Zhu Zhu
Piotr Nowojski 于2019年8月23日周五 下午3:20写道:
> Hi,
>
> Yun:
>
> Thanks for proposing the idea. I have checked the document and left couple
> of questions there, but it might be better to answer them here.
>
> What is the exact mot
Hi Piotr,
Yes you are right it's a distributed cross join requirement.
Broadcast join can help with cross join cases. But users cannot use it if
the data set to join is too large to fit into one subtask.
Sorry for left some details behind.
Thanks,
Zhu Zhu
Piotr Nowojski 于2019年8月23日周五 下午4
a commonly known scenario, I think users can benefit from cross
join sooner or later.
Thanks,
Zhu Zhu
Piotr Nowojski 于2019年8月23日周五 下午6:19写道:
> Hi,
>
> Thanks for the answers :) Ok I understand the full picture now. +1 from my
> side on solving this issue somehow. But before we start dis
Hi Piotr,
Thanks for the explanation.
Agreed that the broadcastEmit(record) is a better choice for broadcasting
for the iterations.
As broadcasting for the iterations is the first motivation, let's support
it first.
Thanks,
Zhu Zhu
Yun Gao 于2019年8月23日周五 下午11:56写道:
>
+1 since Java Duration is more common and powerful than Flink Time.
For whether to drop scala Duration for parsing duration OptionConfig, I
think it's another question and should be discussed in another thread.
Thanks,
Zhu Zhu
Becket Qin 于2019年8月24日周六 下午4:16写道:
> +1, makes sense.
One optimization that we take is letting yarn to reuse the flink-dist jar
which was localized when running previous jobs.
Thanks,
Zhu Zhu
Jörn Franke 于2019年8月30日周五 下午4:02写道:
> Increase replication factor and/or use HDFS cache
> https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/
In our production, we usually override the restart delay to be 10 s.
We once encountered cases that external services are overwhelmed by
reconnections from frequent restarted tasks.
As a safer though not optimized option, a default delay larger than 0 s is
better in my opinion.
未来阳光 <2217232...@q
ed cache of YARN.
In this way, the localized dist jar can be shared by different YARN
applications and it will not be removed when the YARN application which
localized it terminates.
This requires some changes in Flink though.
We will open a ISSUE to contribute this optimization to the community.
Thank
he default restart delay of 0s
causing problems) is ongoing and we may need to take the result from that.
Thanks,
Zhu Zhu
Becket Qin 于2019年9月2日周一 上午9:06写道:
> +1. The new behavior makes sense to me.
>
> BTW, we need a FLIP for this :)
>
> On Fri, Aug 30, 2019 at 10:17 PM Till Rohrman
should be *StreamingJobGraphGenerator*, as
*StreamGraphGenerator* is not aware of JobGraph and pipelined region.
Thanks,
Zhu Zhu
Xintong Song 于2019年9月2日周一 上午11:59写道:
> Updated the FLIP wiki page [1], with the following changes.
>
>- Remove the step of converting pipelined edges between differen
1s looks good to me.
And I think the conclusion that when a user should override the delay is
worth to be documented.
Thanks,
Zhu Zhu
Steven Wu 于2019年9月3日周二 上午4:42写道:
> 1s sounds a good tradeoff to me.
>
> On Mon, Sep 2, 2019 at 1:30 PM Till Rohrmann wrote:
>
>> Thanks
Thanks Xintong for the explanation.
For question #1, I think it's good as long as DataSet job behaviors remains
the same.
For question #2, agreed that the resource difference is small enough(at
most 1 edge diff) in current supported point-wise execution edge connection
patterns.
Thanks,
Zh
+1 (non-binding)
Thanks,
Zhu Zhu
Till Rohrmann 于2019年9月4日周三 下午5:05写道:
> Hi everyone,
>
> I would like to start the voting process for FLIP-61 [1], which is
> discussed and reached consensus in this thread [2].
>
> Since the change is rather small I'd like to shorten th
+1 (non-binding)
Thanks,
Zhu Zhu
Till Rohrmann 于2019年9月4日周三 下午5:06写道:
> Hi everyone,
>
> I would like to start the voting process for FLIP-62 [1], which
> is discussed and reached consensus in this thread [2].
>
> Since the change is rather small I'd like to shorten th
Thanks Xintong for proposing this better resource management.
This helps a lot to users who want to better manage the job resources. And
would be even more useful if in the future we can have auto-tuning
mechanism for jobs.
+1 (non-binding)
Thanks,
Zhu Zhu
Xintong Song 于2019年9月6日周五 上午11:17写道
Congratulations Kostas!
Thanks,
Zhu Zhu
Yu Li 于2019年9月6日周五 下午10:49写道:
> Congratulations Klou!
>
> Best Regards,
> Yu
>
>
> On Fri, 6 Sep 2019 at 22:43, Forward Xu wrote:
>
> > Congratulations Kloudas!
> >
> >
> > Best,
> >
> &
state.
Thanks,
Zhu Zhu
Dian Fu 于2019年9月6日周五 下午8:17写道:
> When a WindowOperator receives all the barrier from the upstream, it will
> forward the barrier to downstream operator and perform the checkpoint
> asynchronously.
> It doesn't have to wait the window to trigger befor
Thanks Gary for kicking off this discussion.
Really appreciate that you and Yu offer to help to manage 1.10 release.
+1 for Gary and Yu as release managers.
Thanks,
Zhu Zhu
Dian Fu 于2019年9月7日周六 下午12:26写道:
> Hi Gary,
>
> Thanks for kicking off the release schedule of 1.10. +1 for you
Congratulations Zili!
Thanks,
Zhu Zhu
Terry Wang 于2019年9月11日周三 下午5:34写道:
> Congratulations!
>
> Best,
> Terry Wang
>
>
>
> 在 2019年9月11日,下午5:28,Dian Fu 写道:
>
> Congratulations!
>
> 在 2019年9月11日,下午5:26,Jeff Zhang 写道:
>
> Congratulations Zili Che
hanks,
Zhu Zhu
estart-strategy:
org.foobar.MyRestartStrategyFactoryFactory".
The usage of restart strategies you mentioned will keep working with the
new scheduler.
Thanks,
Zhu Zhu
Oytun Tez 于2019年9月12日周四 下午10:05写道:
> Hi Zhu,
>
> We are using custom restart strategy like this:
>
> environment.setRestartStrategy(f
+1 (binding)
Thanks,
Zhu
Tzu-Li (Gordon) Tai 于2023年6月17日周六 11:32写道:
>
> +1 (binding)
>
> On Fri, Jun 16, 2023, 09:53 Jing Ge wrote:
>
> > +1(binding)
> >
> > Best Regards,
> > Jing
> >
> > On Fri, Jun 16, 2023 at 10:10 AM Lijie Wang
> > wrote:
> >
> > > +1 (binding)
> > >
> > > Thanks for driv
+1 (binding)
Thanks,
Zhu
Rui Fan <1996fan...@gmail.com> 于2023年6月24日周六 12:28写道:
>
> +1(binding), thanks for driving this improvement.
>
> Best,
> Rui Fan
>
> On Sat, Jun 24, 2023 at 4:55 AM Jing Ge wrote:
>
> > +1(binding)
> >
> > Best Regards,
> > Jing
> >
> > On Fri, Jun 23, 2023 at 5:50 PM Lij
Thanks Dong and Yunfeng for creating this FLIP and driving this discussion.
The new design looks generally good to me. Increasing the checkpoint
interval when the job is processing backlogs is easier for users to
understand and can help in more scenarios.
I have one comment about the new configur
+1 (binding)
Thanks,
Zhu
ConradJam 于2023年7月3日周一 22:39写道:
>
> +1 (no-binding)
>
> Matthias Pohl 于2023年7月3日周一 22:33写道:
>
> > Thanks, Becket
> >
> > +1 (binding)
> >
> > On Mon, Jul 3, 2023 at 10:44 AM Jing Ge
> > wrote:
> >
> > > +1(binding)
> > >
> > > On Mon, Jul 3, 2023 at 10:19 AM Stefan Ric
Congratulations everyone!
Thanks,
Zhu
Hang Ruan 于2023年7月4日周二 14:06写道:
>
> Congratulations!
>
> Best,
> Hang
>
> Jingsong Li 于2023年7月4日周二 13:47写道:
>
> > Congratulations!
> >
> > Thank you! All of the Flink community!
> >
> > Best,
> > Jingsong
> >
> > On Tue, Jul 4, 2023 at 1:24 PM tison wrote:
Agreed that we should deprecate affected APIs as soon as possible.
But there is not much time before the feature freeze of 1.18, hence
I'm a bit concerned that some of the deprecations might not be done 1.18.
We are currently looking into the improvements of the configuration layer.
Most of the p
+1
Thanks,
Zhu
Jing Ge 于2023年7月18日周二 19:09写道:
>
> +1
>
> On Tue, Jul 18, 2023 at 1:05 PM Maximilian Michels wrote:
>
> > +1
> >
> > On Tue, Jul 18, 2023 at 12:29 PM Gyula Fóra wrote:
> > >
> > > +1
> > >
> > > On Tue, 18 Jul 2023 at 12:12, Xintong Song
> > wrote:
> > >
> > > > +1
> > > >
> >
+1 (binding)
Thanks,
Zhu
yuxia 于2023年7月20日周四 09:23写道:
>
> +1(binding)
>
> Best regards,
> Yuxia
>
> - 原始邮件 -
> 发件人: "Guowei Ma"
> 收件人: "dev"
> 发送时间: 星期三, 2023年 7 月 19日 下午 1:54:52
> 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when
> source is processing backlog
+1 (binding)
Thanks,
Zhu
Xintong Song 于2023年7月25日周二 09:46写道:
>
> +1 (binding)
>
> Best,
>
> Xintong
>
>
>
> On Mon, Jul 24, 2023 at 11:58 PM Jing Ge wrote:
>
> > +1
> >
> > On Mon, Jul 24, 2023 at 11:43 PM Chesnay Schepler
> > wrote:
> >
> > > I update the endpoint in the FLIP.
> > >
> > > On
+1 (binding)
Thanks,
Zhu
Xintong Song 于2023年7月25日周二 09:46写道:
>
> +1 (binding)
>
> Best,
>
> Xintong
>
>
>
> On Mon, Jul 24, 2023 at 11:26 PM Jing Ge wrote:
>
> > +1(binding)
> >
> > On Mon, Jul 24, 2023 at 8:55 PM Matthias Pohl
> > wrote:
> >
> > > +1 (binding)
> > >
> > > On Mon, Jul 24, 2023
+1 (binding)
Thanks,
Zhu
Leonard Xu 于2023年7月26日周三 15:40写道:
>
> Thanks @xingtong for driving the work.
>
> +1(binding)
>
> Best,
> Leonard
>
> > On Jul 26, 2023, at 3:18 PM, Konstantin Knauf
> > wrote:
> >
> > Hi Xingtong,
> >
> > yes, I am fine with the conclusion for SourceFunction. I chatted
ined resources. The proposed config option
`slot.request.max-interval`
then can be renamed to `taskmanager.load-balance.request-stablizing-timeout`
to show its relation with the feature. The proposed `slot.sharing-strategy`
is not needed, because the configured "Tasks" mode will do the wor
> example 2 of section 2.2.3 can be resolved. Do I understand it
> >> >> > > > correctly?
> >> >> > >
> >> >> > > The example assigned result is the final allocation result when
> flink
> >> >> > > us
gic of 'Slots'
> and
> 'Tasks' are exactly the same, it feels a bit strange to define two
> enumerations.
> And it may cause confusion to users.
>
> If they are totally the same, how about combining them to SlotsAndTasks?
> It can be compatible with '
+1 (binding)
Thanks,
Zhu
Jane Chan 于2023年10月13日周五 17:00写道:
> +1 (non-binding)
>
> Best,
> Jane
>
> On Fri, Oct 13, 2023 at 11:20 AM Yuxin Tan wrote:
>
> > +1(non-binding)
> >
> > Best,
> > Yuxin
> >
> >
> > Zhanghao Chen 于2023年10月13日周五 10:54写道:
> >
> > > +1 (non-binding)
> > >
> > > Best,
> >
+1 (binding)
Thanks,
Zhu
Yuepeng Pan 于2023年10月25日周三 11:32写道:
> +1 (non-binding)
>
> Regards,
> Yuepeng Pan
>
> On 2023/10/23 08:25:30 xiangyu feng wrote:
> > Thanks for driving that.
> > +1 (non-binding)
> >
> > Regards,
> > Xiangyu
> >
> > Yu Chen 于2023年10月23日周一 15:19写道:
> >
> > > +1 (non-bin
1] document for more details about the
> proposed design and implementation.
>
> I also thank Zhu Zhu and LiJie Wang for their suggestions during the
> pre-discussion.
> Looking forward to your feedback and suggestions, thanks.
>
> [1]
>
> https://cwiki.apache.org/confluence
Thanks Junrui for creating the FLIP and kicking off this discussion.
The community has been constantly striving to unify and simplify the
configuration layer of Flink. Some progress has already been made,
such as FLINK-29379. However, the compatibility of public interfaces
poses an obstacle to com
+1 (binding)
Thanks,
Zhu
Xia Sun 于2023年11月13日周一 15:02写道:
> +1 (non-binding)
>
> Best,
> Xia
>
> Samrat Deb 于2023年11月13日周一 12:37写道:
>
> > +1 (non binding)
> >
> > Bests,
> > Samrat
> >
> > On Mon, 13 Nov 2023 at 9:10 AM, Yangze Guo wrote:
> >
> > > +1 (binding)
> > >
> > > Best,
> > > Yangze G
s some issues:
> >> > > 1. The exponential-delay doesn't have the max attempts mechanism,
> >> > > it means that flink will restart indefinitely even if it fails
> >> frequently.
> >> > > 2. For multi-region streaming jobs and all batch jobs, the failure
> o
Thanks Junrui for creating the FLIP and kicking off this discussion.
Exposing a mutable ExecutionConfig which is even shared by multiple
operators is truly a defect which can result in weird results.
+1
Thanks,
Zhu
Junrui Lee 于2023年11月15日周三 16:53写道:
> Hi all,
>
> I'd like to start a discussio
+1 (binding)
- verified checksum and signature
- verified the source archive does not contain any binary
- built from source code successfully
- checked the web pr
Thanks,
Zhu
Xintong Song 于2023年11月15日周三 10:42写道:
> +1 (binding)
>
> - verified checksum and signature
> - verified license and not
+1 (binding)
Thanks,
Zhu
Rui Fan <1996fan...@gmail.com> 于2023年11月28日周二 13:11写道:
> +1(binding)
>
> Best,
> Rui
>
> On Tue, Nov 28, 2023 at 12:34 PM Junrui Lee wrote:
>
> > Hi everyone,
> >
> > Thank you to everyone for the feedback on FLIP-391: Deprecate
> > RuntimeContext#getExecutionConfig[1]
+1
Thanks,
Zhu
Xia Sun 于2023年11月30日周四 11:41写道:
> Hi everyone,
>
> I'd like to start a vote on FLIP-379: Dynamic source parallelism inference
> for batch jobs[1] which has been discussed in this thread [2].
>
> The vote will be open for at least 72 hours unless there is an objection or
> not eno
+1 (binding)
Thanks,
Zhu
Zhanghao Chen 于2023年11月30日周四 23:31写道:
> +1 (non-binding)
>
> Best,
> Zhanghao Chen
>
> From: Rui Fan <1996fan...@gmail.com>
> Sent: Monday, November 13, 2023 11:01
> To: dev
> Subject: [VOTE] FLIP-364: Improve the restart-strategy
>
> H
Thanks Yong for creating the FLIP and starting the discussion.
Having a unified config option for all kinds of serializers can make it
much easier
for users to set, track and maintain the serializers for jobs.
+1
Thanks,
Zhu
weijie guo 于2023年12月12日周二 14:01写道:
> Thanks for driving this, Yong.
+1 (binding)
Thanks,
Zhu
Matthias Pohl 于2023年12月12日周二 01:32写道:
> Hi everyone,
> I'd like to start a vote on FLIP-335 [1]. It covers the deprecation (and
> Flink 2.0-related removal) of Flink's Time classes in favor of Java's
> Duration class.
>
> The related discussion thread can be found in [2
parse the config? Pre-defined ConfigOptions are better
for configuration maintenance, compared to arbitrary strings
Thanks,
Zhu
Rui Fan <1996fan...@gmail.com> 于2023年12月13日周三 19:27写道:
> Thanks Martijn for the quick clarification!
>
> I see Zhu Zhu and Junrui Lee are working on configur
+1 (binding)
Thanks,
Zhu
Xintong Song 于2023年12月14日周四 15:36写道:
> +1 (binding)
>
> Best,
>
> Xintong
>
>
>
> On Thu, Dec 14, 2023 at 3:15 PM Lijie Wang
> wrote:
>
> > Hi devs, Thanks for all feedback about the FLIP-383: Support Job Recovery
> > for Batch Jobs[1]. This FLIP was discussed in [2].
gt; >> most
> >>>>>> effective way is to not allow accessing a specific option with a
> >>>>>> string-key, so that developers not awaring of this discussion won't
> >>>>>> accidentally use it. On the other hand, case-2 is a m
+1 (binding)
Thanks,
Zhu
Rui Fan <1996fan...@gmail.com> 于2023年12月19日周二 17:17写道:
> Hi everyone,
>
> Thank you to everyone for the feedback on FLIP-364:
> Improve the restart-strategy[1] which has been voted in this thread[2].
>
> After the vote on FLIP-364, there was some feedback on the user mai
+1 (binding)
Thanks,
Zhu
Zhanghao Chen 于2023年12月27日周三 15:41写道:
> +1 (non-binding)
>
> Best,
> Zhanghao Chen
>
> From: Yong Fang
> Sent: Wednesday, December 27, 2023 14:54
> To: dev
> Subject: [VOTE] FLIP-398: Improve Serialization Configuration And Usage In
>
Thanks for creating the FLIP and starting the discussion, Yangze. It makes
sense to me to improve the job submission performance in OLAP scenarios.
I have a few questions regarding the proposed changes:
1. How about skipping the job graph persistence if the proposed config
'high-availability.enab
age except for the job graph store.
>
> WDYT?
>
> [1]
> https://issues.apache.org/jira/browse/FLINK-31816?focusedCommentId=17741054&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17741054
>
> Best,
> Yangze Guo
>
> On Mon, Jan 8, 2024 a
+1 (binding)
Thanks,
Zhu
Hangxiang Yu 于2024年1月11日周四 14:26写道:
> +1 (non-binding)
>
> On Thu, Jan 11, 2024 at 11:19 AM Xuannan Su wrote:
>
> > +1 (non-binding)
> >
> > Best,
> > Xuannan
> >
> > On Thu, Jan 11, 2024 at 10:28 AM Xuyang wrote:
> > >
> > > +1 (non-binding)--
> > >
> > > Best!
>
+1 (binding)
Thanks,
Zhu
Xuannan Su 于2024年1月12日周五 14:24写道:
> Hi all,
>
> I would like to clarify the statement regarding the first improvement
> from the previous email, as it was incomplete. To be more specific, we
> will also deprecate the getClass(String key, Class
> defaultValue, ClassLoade
The commit info is shown as on the web UI and in logs.
Not sure if it's a common issue or just happens to my build only.
Thanks,
Zhu Zhu
aihua li 于2020年2月9日周日 下午7:42写道:
> Yes, but the results you see in the Performance Code Speed Center [3] skip
> FLIP-49.
> The results
elism=1000 on yarn
cluster, with the new scheduler and legacy scheduler, the job runs well
(tuned some resource configs to enable the jobs to work well)
* killed TMs to trigger failures, the jobs can finally recover from the
failures
Thanks,
Zhu Zhu
Zhu Zhu 于2020年2月10日周一 上午12:31写道:
> The c
as well as the git tag
- checked the website pull request
Thanks,
Zhu Zhu
Ufuk Celebi 于2020年2月14日周五 上午12:32写道:
> PS: Also verified the NOTICE changes since the last RC.
>
> On Thu, Feb 13, 2020 at 5:25 PM Ufuk Celebi wrote:
>
> > Hey Chensay,
> >
> > +1 (binding).
Thanks Chesnay for the great work and everyone who helps with the
improvements and release!
Thanks,
Zhu Zhu
Dian Fu 于2020年2月20日周四 上午9:44写道:
> Thanks Chesnay for the great work and everyone involved!
>
> Regards,
> Dian
>
> > 在 2020年2月20日,上午12:21,Zhijiang 写道:
> >
&g
Thanks Piotr and Zhijiang for volunteering as the release managers!
+1 for aiming with the feature freeze date for end of April.
Thanks,
Zhu Zhu
Piotr Nowojski 于2020年2月20日周四 下午4:26写道:
> Hi,
>
> Thank you for giving me and Zhijiang opportunity and entrusting us with
> the release :
Congratulations Jingsong!
Thanks,
Zhu Zhu
Fabian Hueske 于2020年2月22日周六 上午1:30写道:
> Congrats Jingsong!
>
> Cheers, Fabian
>
> Am Fr., 21. Feb. 2020 um 17:49 Uhr schrieb Rong Rong >:
>
> > Congratulations Jingsong!!
> >
> > Cheers,
> > Rong
> >
+1 (binding)
It can be very helpful to check GC state when GC logging is enabled.
Thanks,
Zhu Zhu
zhenya Sun 于2020年2月24日周一 下午3:51写道:
> 1
>
>
> able-sun
>
>
> On 02/24/2020 15:45,jincheng sun wrote:
> +1(binding) Thank you for driving this Yadong!
>
> Best,
>
Thanks for reporting this Yangze.
I have update the permission to those images. Everyone are able to view
them now.
Thanks,
Zhu Zhu
Yangze Guo 于2020年3月27日周五 上午11:25写道:
> Thanks for driving this discussion, Zhu Zhu & Gary.
>
> I found that the image link in this FLIP is not working
pe of the FLIP. But we are moving forward to a more
extensible scheduler (FLINK-10429) and resource aware scheduling
(FLINK-10407).
So I think it's possible we can have a scheduler in the future which
dynamically changes the shuffle type wisely regarding available resources.
Thanks,
Zhu Z
nding requests right after
the requests are sent to TM without confirming wether the slot offers
succeed). We can look deeper into it later when we are about to support
variant sizes slots.
Thanks,
Zhu Zhu
Till Rohrmann 于2020年3月27日周五 下午10:59写道:
> Thanks for creating this FLIP Zhu Zhu and Gary!
&
Thanks for the nice suggestion Till.
The section 'Bulk Slot Allocation' is updated.
Thanks,
Zhu Zhu
Gary Yao 于2020年3月30日周一 下午3:38写道:
> >
> > The links work for me now. Someone might have fixed them. Never mind.
> >
>
> Actually, I fixed the links after seein
should not be a problem in most cases but might be a problem for large
scale jobs. Shall we have an benchmark for it?
Thanks,
Zhu Zhu
Yangze Guo 于2020年3月31日周二 下午2:19写道:
> Thank you all for the feedback! Sorry for the belated reply.
>
> @Till
> I'm +1 for your two ideas and I
can be also composed of a
JobID
and an index as Till proposed.
Thanks,
Zhu Zhu
Till Rohrmann 于2020年3月31日周二 下午8:36写道:
> For the IntermediateDataSetID I was just thinking that it might actually be
> interesting to know which job produced the result which, by using cluster
> partitions
Congratulations Konstantin, Dawid and Zhijiang!
Thanks,
Zhu Zhu
Piotr Nowojski 于2020年4月1日周三 下午7:18写道:
> Congratulations :)
>
> > On 1 Apr 2020, at 13:05, Canbin Zheng wrote:
> >
> > Congratulations to all of you!
> >
> > Regards,
> > Canbin Z
+1 (binding)
Thanks,
Zhu Zhu
Kurt Young 于2020年4月3日周五 下午5:25写道:
> +1 (binding)
>
> Best,
> Kurt
>
>
> On Fri, Apr 3, 2020 at 4:02 PM Yangze Guo wrote:
>
> > +1 (non-binding)
> >
> > Best,
> > Yangze Guo
> >
> > On Fri, Apr 3, 2020 a
Congratulations, Seth!
Thanks,
Zhu Zhu
Dian Fu 于2020年4月7日周二 下午2:43写道:
> Congratulations!
>
> > 在 2020年4月7日,下午2:35,Konstantin Knauf 写道:
> >
> > Congratulations, Seth! Well deserved :)
> >
> > On Tue, Apr 7, 2020 at 8:33 AM Tzu-Li (Gordon) Tai
> >
ultPartitionIDs can
share the same IntermediateDataSetID, in this way the space of
IntermediateResultPartitionID is a ref (to IntermediateDataSetID) and an
int (index), which is smaller than 2 Longs (AbstractID).
Thanks,
Zhu Zhu
Yangze Guo 于2020年4月14日周二 下午3:09写道:
> Hi everyone,
>
> I
Thanks for proposing this improvement, Yangze.
+1 (binding)
Thanks,
Zhu Zhu
Zhijiang 于2020年4月17日周五 下午12:36写道:
> Thanks for this FLIP, Yangze.
>
> Sorry for not involving in the previous discussion. In general I like the
> proposed direction to make related IDs have more rich inf
Congratulations Hequn!
Thanks,
Zhu Zhu
zoudan 于2020年4月20日周一 上午10:34写道:
> Congratulations Hequn
>
> Best,
> Dan Zou
>
>
> > 在 2020年4月20日,10:23,Terry Wang 写道:
> >
> > Congratulations Hequn !!!
> > Best,
> > Terry Wang
> >
> >
> >
+1 (non-binding)
- checked release notes
- checked signatures
- built from source
- submitted an example job on yarn cluster
- WebUI and logs look good
Thanks,
Zhu Zhu
Yu Li 于2020年4月22日周三 下午2:55写道:
> +1 (non-binding)
>
> - Checked release notes: OK
> - Checked sums and si
+1 for extending the code freeze date.
FLIP-119 could benefit from it.
May 15th sounds reasonable.
Thanks,
Zhu Zhu
Jark Wu 于2020年4月24日周五 上午12:01写道:
> +1
>
> Thanks,
> Jark
>
> On Thu, 23 Apr 2020 at 22:36, Xintong Song wrote:
>
> > +1
> > From our side we ca
Flink 1.10
Other usages are still supported, including all the strategies and
configuring ways described in
https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/task_failure_recovery.html#restart-strategies
.
Feel free to share in this thread if you has any concern for it.
Thanks,
Zh
Thanks Steven for the feedback!
Could you share more information about the metrics you add in you
customized restart strategy?
Thanks,
Zhu Zhu
Steven Wu 于2019年9月20日周五 上午7:11写道:
> We do use config like "restart-strategy:
> org.foobar.MyRestartStrategyFactoryFactory". Mainly t
not be restarted when task failures happen and the "fullRestart"
value will not increment in such cases.
I'd appreciate if you can help with these questions and we can make better
decisions for Flink.
Thanks,
Zhu Zhu
Steven Wu 于2019年9月22日周日 上午3:31写道:
> Zhu Zhu,
>
> Flink fullRes
ric to show failovers that respects
fine grained recovery.
[1] https://issues.apache.org/jira/browse/FLINK-14164
Thanks,
Zhu Zhu
Steven Wu 于2019年9月24日周二 上午6:41写道:
>
> When we setup alert like "fullRestarts > 1" for some rolling window, we
> want to use counter. if it i
Hi Steven,
As a conclusion, since we will have a meter metric[1] for restarts,
customized restart strategy is not needed in your case.
Is that right?
[1] https://issues.apache.org/jira/browse/FLINK-14164
Thanks,
Zhu Zhu
Steven Wu 于2019年9月25日周三 上午2:30写道:
> Zhu Zhu,
>
> Sorry, I
We will then keep the decision that we do not support customized restart
strategy in Flink 1.10.
Thanks Steven for the inputs!
Thanks,
Zhu Zhu
Steven Wu 于2019年9月26日周四 上午12:13写道:
> Zhu Zhu, that is correct.
>
> On Tue, Sep 24, 2019 at 8:04 PM Zhu Zhu wrote:
>
>> Hi
Thanks Chesnay for this improvement!
vino yang 于2019年10月18日周五 上午10:29写道:
> Thanks Chesnay! Great job!
>
> Best,
> Vino
>
> Jark Wu 于2019年10月18日周五 上午9:51写道:
>
> > Thanks Chesnay! This is really a great job!
> >
> > Best,
> > Jark
> >
> > > 在 2019年10月17日,22:03,未来阳光 <2217232...@qq.com> 写道:
> > >
>
+1 to drop the non credit-based flow control.
We have turned to credit-based flow control for long in production. It has
been good for all our cases.
The non credit-based flow control code has been a burden when we are trying
to change the network stack code for new features.
Thanks,
Zhu Zhu
ecome available, especially for a sequence of short lived jobs. This
however introduces JM dependency on RM on job finishes, which is unwanted.
Thanks,
Zhu Zhu
Chesnay Schepler 于2019年10月15日周二 下午6:48写道:
> I have updated the FLIP.
>
> - adopted job-/cluster partitions naming scheme
> - ou
Thanks Till for the explanation! That looks good to me.
Thanks,
Zhu Zhu
Till Rohrmann 于2019年10月21日周一 上午2:45写道:
> Hi Zhu Zhu,
>
> the cluster partition does not need to be registered at the RM before it
> can be used. The cluster partition descriptor will be reported to the
> cl
Thanks Chesnay for proposing this improvement!
It's meaningful for interactive query and the design looks good.
+1 (non-binding)
Thanks,
Zhu Zhu
Till Rohrmann 于2019年10月17日周四 下午8:48写道:
> Thanks for creating this FLIP and starting the VOTE for it.
>
> +1 (binding)
>
> Cheer
+1 (non-binding)
Thanks,
Zhu Zhu
Biao Liu 于2019年10月22日周二 上午11:06写道:
> +1 (non-binding)
>
> Thanks,
> Biao /'bɪ.aʊ/
>
>
>
> On Tue, 22 Oct 2019 at 10:26, Jark Wu wrote:
>
> > +1 (non-binding)
> >
> > Best,
> > Jark
> >
> >
1 - 100 of 499 matches
Mail list logo