+1 and thanks for Chesnay' work on this.
Best,
Zhijiang
--
From:Haibo Sun
Send Time:2019年7月4日(星期四) 18:21
To:dev
Cc:priv...@flink.apache.org
Subject:Re:Re: [VOTE] Migrate to sponsored Travis account
+1. Thank Chesnay for pu
Congratulations Rong!
Best,
Zhijiang
--
From:Kurt Young
Send Time:2019年7月11日(星期四) 22:54
To:Kostas Kloudas
Cc:Jark Wu ; Fabian Hueske ; dev
; user
Subject:Re: [ANNOUNCE] Rong Rong becomes a Flink committer
Congratulations Rong
Congrats Becket!
Best,
Zhijiang
--
From:Zhu Zhu
Send Time:2019年7月18日(星期四) 16:35
To:dev
Subject:Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to
the Flink project
Congratulations Becket!
Xintong Song 于2019年7
Congrats Kurt!
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2019年7月23日(星期二) 21:08
To:dev
Subject:Re: [ANNOUNCE] Kete Young is now part of the Flink PMC
Congrats Kurt!
Cheers,
Till
On Tue, Jul 23, 2019 at 3:00 PM Dawid
Thanks everyone!
This is definitely a honor for me. It is very pleasant to work with you guys
and I would try my best to contribute to the community future.
Best,
Zhijiang
--
From:Dawid Wysakowicz
Send Time:2019年7月23日(星期二) 21:01
.
Best,
Zhijiang
--
From:Tzu-Li (Gordon) Tai
Send Time:2019年7月27日(星期六) 10:41
To:dev
Subject:Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release
Hi all,
It's been a while since our last update for the release testi
Congratulations Hequn!
Best,
Zhijiang
--
From:Xuefu Z
Send Time:2019年8月7日(星期三) 20:35
To:dev
Subject:Re: [ANNOUNCE] Hequn becomes a Flink committer
Congratulations， Hequn！
On Wed, Aug 7, 2019 at 11:08 AM Yun Tang wrote
/1eDpsUKv2FqwZiS1Pm6gYO5eFHScBHfULKmH1-ZEWB4g/edit
[3]
https://docs.google.com/document/d/13x9M7k1SRqkOFXP0bETcJemIRyJzoqGgkdy11pz5qHM/edit?usp=sharing
Best,
Zhijiang
improvments for the release-1.10.
[1] https://issues.apache.org/jira/browse/FLINK-8523
Best,
Zhijiang
--
From:Thomas Weise
Send Time:2019年8月12日(星期一) 21:38
To:dev
Subject:Checkpointing under backpressure
Hi,
One of the major
proposed suggestion is helpful on my side, especially considering
some implementation details .
Best,
Zhijiang
--
From:Paris Carbone
Send Time:2019年8月13日(星期二) 14:03
To:dev
Cc:zhijiang
Subject:Re: Checkpointing under backpressure
queue. Actually
we ever implemented
this improvement in Alibaba's private branch and it was running long time in
real prodcution. It indeeds
speed up barrier alignment a bit if the blocked input channels have some
buffers.
Best,
Zhi
Congratulations Andrey, great work and well deserved!
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2019年8月14日(星期三) 15:26
To:dev ; user
Subject:[ANNOUNCE] Andrey Zagrebin becomes a Flink committer
Hi everyone,
I'm very hap
ut and we only need to wait it
finish. Then are there still any other problems/concerns if checkpoint takes
long time to finish? Althougn we already knew some issues before, it is better
to gather more user feedbacks to confirm which aspects could be solved in this
feature des
oint finish quickly and then tune
the setting to avoid backpressure is really a pratical case. I think this
solution could cover this concern.
Best,
Zhijiang
--
From:Thomas Weise
Send Time:2019年8月14日(星期三) 19:48
To:dev ; zhijian
It is really very convenient now. Valuable work, Chesnay!
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2019年8月22日(星期四) 10:13
To:dev
Subject:Re: CiBot Update
Thanks for the continuous work on the CiBot Chesnay!
Cheers,
Till
On
.
Best,
Zhijiang
--
From:Zhu Zhu
Send Time:2019年9月2日(星期一) 05:18
To:dev
Subject:Re: [DISCUSS] Simplify Flink's cluster level RestartStrategy
configuration
+1 to simplify the RestartStrategy configuration
One thing to confi
out of the vote scope, just think of
we have this issue in [1]. :)
[1] https://issues.apache.org/jira/browse/FLINK-12110
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2019年9月3日(星期二) 15:07
To:dev
Subject:Re: [VOTE] FLIP-49: Unif
+1
Best,
Zhijiang
--
From:Jark Wu
Send Time:2019年9月4日(星期三) 13:45
To:dev
Subject:Re: [VOTE] FLIP-62: Set default restart delay for FixedDelay- and
FailureRateRestartStrategy to 1s
+1
Best,
Jark
> 在 2019年9月4日，19:43，David Morá
+1
--
From:Till Rohrmann
Send Time:2019年9月4日(星期三) 13:39
To:dev
Cc:Zhu Zhu
Subject:Re: [VOTE] FLIP-61 Simplify Flink's cluster level RestartStrategy
configuration
+1 (binding)
On Wed, Sep 4, 2019 at 12:39 PM Chesnay Schepler wro
Congratulations Klou!
Best,
Zhijiang
--
From:Zhu Zhu
Send Time:2019年9月6日(星期五) 17:19
To:dev
Subject:Re: [ANNOUNCE] Kostas Kloudas joins the Flink PMC
Congratulations Kostas!
Thanks,
Zhu Zhu
Yu Li 于2019年9月6日周五 下午10:49写道
owest priority if possible.
[1] https://issues.apache.org/jira/browse/FLINK-10745
[2] https://issues.apache.org/jira/browse/FLINK-10742
Best,
Zhijiang
--
From:Gary Yao
Send Time:2019年9月6日(星期五) 17:06
To:dev
Cc:carp84
Subject:[DI
Congratulations Zili！
--
From:Becket Qin
Send Time:2019年9月12日(星期四) 03:43
To:Paul Lam
Cc:Rong Rong ; dev ; user
Subject:Re: [ANNOUNCE] Zili Chen becomes a Flink committer
Congrats, Zili!
On Thu, Sep 12, 2019 at 9:39 AM Paul Lam wr
ractive with
ShuffleMaster to release global partitions. Then it might be better to move
ShuffleMaster outside of JM, and the lifecycle of ShuffleMaster should be
consistent with RM.
5. Nit: TM->TE in the section of Proposed Changes: "TMs retain global
partition
+1 (binding)
Best,
Zhijiang
--
From:Kurt Yang
Send Time:2024年1月12日(星期五) 15:31
To:dev
Subject:Re: Re: Re: [VOTE] Accept Flink CDC into Apache Flink
+1 (binding)
Best,
Kurt
On Fri, Jan 12, 2024 at 2:21 PM Hequn Cheng wrote:
>
Really great work and thanks everyone involved, especially for the release
managers!
Best,
Zhijiang
--
From:Kurt Young
Send Time:2020 Feb. 13 (Thu.) 11:06
To:[None]
Cc:user ; dev
Subject:Re: [ANNOUNCE] Apache Flink 1.10.0 released
+1 (binding), it is valuable to enhance the python API for supporting ML well.
Best,
Zhijiang
--
From:Dian Fu
Send Time:2020 Feb. 14 (Fri.) 15:07
To:dev
Subject:Re: [VOTE] Support Python ML Pipeline API
+1 (binding)
Regards
+1 (non-binding)
- Checked the release notes
- Downloaded the source and built successfully
- Verified the signature and checksum
- Verified the artifacts in the Maven Central Repository
Best,
Zhijiang
--
From:Robert Metzger
Send
ne/benefit for other writings.
It also reminded me to extend the Flink glossary if necessary.
Best,
Zhijiang
--
From:Jingsong Li
Send Time:2020 Feb. 15 (Sat.) 23:21
To:dev
Subject:Re: [ANNOUNCE] New Documentation Style Guide
Thank for
for some people who prefer to google doc
or willing to provide it in some corner cases.
Of course I am also happy to eliminate google doc completely.
Best,
Zhijiang
--
From:Kostas Kloudas
Send Time:2020 Feb. 18 (Tue.) 23:03
To:dev
lease work was
always well done, and I can learn a lot from these rich experiences.
+1 for the "feature freeze date" around end of April.
Although we have the FF SF in the meantime, fortunately there are no long
public holidays during this period in China.
Thanks Chesnay for making the release efficiently and also thanks to all the
other participants!
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2020 Feb. 19 (Wed.) 22:21
To:dev
Subject:Re: [ANNOUNCE] Apache Flink-shaded 10.0
+1 for splitting the vote thread as @Till mentioned.
I was also wondering whether need to review all the listed FLIPs before voting.
If making them separately, then I am very willing to take some interested ones
for vote. :)
Best,
Zhijiang
+1 (binding).
It seems more clearly and directly to highlight the back pressured vertex in
topology, which can raise the attention of users.
Best,
Zhijiang
--
From:Congxian Qiu
Send Time:2020 Feb. 20 (Thu.) 21:49
To:dev
Congrats Jingsong! Welcome on board!
Best,
Zhijiang
--
From:Zhenghua Gao
Send Time:2020 Feb. 21 (Fri.) 12:49
To:godfrey he
Cc:dev ; user
Subject:Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer
Congrats Jingsong！
Best
respective vertex which slot is pending and the detailed slot id info.
I am curious that is it feasible to do some valid analysis from logs based on
the slot id? Or what's the expectation to use these infos?
Best,
Zhijiang
--
From
f the users do not need to touch these sections by default , which
means without implication. I guess it would save some efforts.
My above concern is tiny and might not be the key motivation of this
discussion. Just share my thoughts by this chance. :)
Best,
Zhijiang
,
Zhijiang
--
From:Yu Li
Send Time:2020 Feb. 26 (Wed.) 12:59
To:dev
Subject:Re: [DISCUSS] FLIP-76: Unaligned checkpoints
Hi All,
Sorry for being late to the discussion. I've gone through the latest FLIP
document and have below ques
even shorten the checkpoint
duration without
obvious performance regression in our previous POC testing. So the backpressure
might not be the only factor to switch to the unaligned way in practice I
guess. Anyway your
inputs are valuable for us to make the final decision.
Best,
Zhij
Big +1 for this proposal and second Ufuk's feeling!
I guess "Engine room" section in Wiki would attract lots of technical fans.:)
Best,
Zhijiang
--
From:Yu Li
Send Time:2020 Mar. 4 (Wed.) 14:42
To:dev
Cc:vthink
ation and message of "This closes #", etc.
Even it might cause unexpected format of long commit content description if not
handled carefully in the text box.
Best,
Zhijiang
--
From:tison
Send Time:2020 Mar. 5 (Thu.) 21:3
Thanks for this proposal Arvid!
+1 and looking forward to the wiki structure and more following blogs.
Best,
Zhijiang
--
From:Dian Fu
Send Time:2020 Mar. 5 (Thu.) 19:08
To:dev
Subject:Re: Flink dev blog
+1 to Arvid's pro
to rely on it.
My previously mentioned other side effects is not serious and can still work
around.
Best
Zhijiang
--
From:Dian Fu
Send Time:2020 Mar. 6 (Fri.) 12:31
To:dev
Subject:Re: [DISCUSS] Disable "Squash and merge&qu
le strict capacity limit for memory usage for RocksDB [48]
Your release managers,
Zhijiang & Piotr Nowojski
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-42%3A+Rework+Flink+Documentation
[2]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-65%3A+New+type+inference+for+Tabl
Thanks for driving this release, Yu!
+1 on my side
Best,
Zhijiang
--
From:Yu Li
Send Time:2020 Mar. 10 (Tue.) 20:25
To:dev
Subject:Re: [DISCUSS] Releasing Flink 1.10.1
Thanks for the supplement Hequn. Yes will also keep
+1 (binding).
As for David's concern of smaller buffers after recovery, I ever had a draft
design [1] to solve this issue.
You can take a look and leave comments if still have concerns. :)
[1]
https://docs.google.com/document/d/16_MOQymzxrKvUHXh6QFr2AAXIKt_2vPUf8vzKy4H_tU/edit
Best,
Zhi
Thanks for all the feedbacks @Hequn @Timo @Godfrey !
We will note your updates and adjust the feature list accordingly in the next
progress announcement.
Best,
Zhijiang
--
From:godfrey he
Send Time:2020 Mar. 11 (Wed.) 17:20
developing it well.
Best,
Zhijiang
--
From:Hequn Cheng
Send Time:2020 Mar. 11 (Wed.) 15:36
To:dev
Subject:Re: [DISCUSS] Link Stateful Functions from the Flink Website
Hi,
Thanks a lot for raising the discussion @Stephan.
+1 to
Thanks for driving this discussion, Robert!
This e2e test really fails frequently. +1 to drop bucketing sink, it is not
worth paying more efforts since deprecated.
Best,
Zhijiang
--
From:Jeff Zhang
Send Time:2020 Mar. 12 (Thu
+1 for this proposal. Very reasonable analysis!
Best,
Zhijiang
--
From:Hequn Cheng
Send Time:2020 Mar. 27 (Fri.) 09:46
To:dev
Cc:private
Subject:Re: [DISCUSS] Creating a new repo to host Stateful Functions Dockerfiles
+1 for a
Thanks for the continuous efforts for engaging in Flink ecosystem Jeff!
Glad to see the progressive achievement. Wish more users try it out in practice.
Best,
Zhijiang
--
From:Dian Fu
Send Time:2020 Mar. 31 (Tue.) 10:15
To:Jeff
s metric may be useful for tuning to
> understand
> how much the mapped memory uses from the direct memory limit to set e.g.
> framework off-heap limit correctly and avoid direct OOM.
> It could be something to discuss with Zhijiang. e.g. is the direct memory
> used there to buff
+1 (binding)
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2020 Apr. 2 (Thu.) 23:09
To:dev
Cc:zhuzh
Subject:Re: [VOTE] FLIP-119: Pipelined Region Scheduling
+1
Cheers,
Till
On Tue, Mar 31, 2020 at 5:52 PM Gary Yao wrote
Congratulations, Seth!
Best,
Zhijiang
--
From:tison
Send Time:2020 Apr. 7 (Tue.) 19:26
To:dev
Subject:Re: [ANNOUNCE] New Flink committer: Seth Wiesman
Congratulations, Seth!
Best,
tison.
Yu Li 于2020年4月7日周二 下午6:57写道
Great work! Thanks Gordon for the continuous efforts for enhancing stateful
functions and the efficient release!
Wish stateful functions becoming more and more popular in users.
Best,
Zhijiang
--
From:Yun Tang
Send Time:2020 Apr
Very nice work! Thanks Yun finding this feature and making it happen!
Best,
Zhijiang
--
From:Xingbo Huang
Send Time:2020 Apr. 9 (Thu.) 20:23
To:dev
Subject:Re: Configuring autolinks to Flink JIRA ticket in github repos
Thanks
+1 for the proposal.
Best,
Zhijiang
--
From:Robert Metzger
Send Time:2020 Apr. 10 (Fri.) 02:15
To:dev
Subject:Re: [DISCUSS] Creating a new repo to host Flink benchmarks
+1 on creating the repo.
On Thu, Apr 9, 2020 at 5:54 PM
`ExecutionAttemptID`, so
we do not need to further consider this issue now.
+1 (binding).
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2020 Apr. 16 (Thu.) 21:39
To:dev
Subject:Re: [VOTE] FLIP-118: Improve Flink’s ID system
Thanks
Congratulations, Hequn!
Best,
Zhijiang
--
From:Yun Gao
Send Time:2020 Apr. 19 (Sun.) 21:53
To:dev
Subject:Re: [ANNOUNCE] New Apache Flink PMC Member - Hequn Chen
Congratulations Hequn!
Best,
Yun
+1 for extending the feature freeze until May 15th.
Best,
Zhijiang
--
From:Danny Chan
Send Time:2020 Apr. 24 (Fri.) 10:51
To:dev
Subject:Re: [DISCUSS] Exact feature freeze date
+1 for extending the feature freeze until May 15th
Thanks Dian for the release work and thanks everyone involved.
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2020 Apr. 27 (Mon.) 15:13
To:Jingsong Li
Cc:dev ; Leonard Xu ; Benchao Li
; Konstantin Knauf ; jincheng
sun ; Hequn
Thanks for writing up this FLIP, Arvid!
Many users would expect this feature and also +1 from my side.
Best,
Zhijiang
--
From:Piotr Nowojski
Send Time:2019年10月7日(星期一) 10:13
To:dev
Subject:Re: [DISCUSS] FLIP-76: Unaligned
in many versions. In Alibaba we are always using the
default credit-based mode in all products.
It can reduce much overhead of maintaining non credit-based code path, so +1
from my side to drop it.
Best,
Zhijiang
--
From:Piotr
artitions directly not via ShuffleMaster. Even the RM could
also pass the global released partitions via payloads in heartbeat with TE to
reduce additional explict RPC call, but this would bring some delays for
releasing partition based on heartbeat interval.
Best,
.
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2019年10月13日(星期日) 17:04
To:zhijiang
Cc:dev
Subject:Re: [DISCUSS] FLIP-67: Global partitions lifecycle
I think we won't necessarily run multiple ShuffleMasters. I think it wou
conclusion. Moreover, Till's recent reply already dispels
my previous concern. :)
Best,
Zhijiang
--
From:Chesnay Schepler
Send Time:2019年10月14日(星期一) 07:00
To:dev ; Till Rohrmann ; zhijiang
Subject:Re: [DISCUSS] FLIP-67: G
+1
Best,
Zhijiang
--
From:Chesnay Schepler
Send Time:2019年10月16日(星期三) 21:01
To:dev@flink.apache.org
Subject:[VOTE] FLINK-67: Cluster partition life-cycle
Hello,
please vote for FLIP-67
<https://cwiki.apache.org/conflue
+1 (non-binding)
Best,
Zhijiang
--
From:Zhu Zhu
Send Time:2019 Oct. 22 (Tue.) 16:33
To:dev
Subject:Re: [VOTE] Accept Stateful Functions into Apache Flink
+1 (non-binding)
Thanks,
Zhu Zhu
Biao Liu 于2019年10月22日周二 上午11:06写道
Congratulations Jark!
Best,
Zhijiang
--
From:bupt_ljy
Send Time:2019 Nov. 8 (Fri.) 19:21
To:dev ; dev@flink.apache.org Yun Gao
Subject:Re: [ANNOUNCE] Jark Wu is now part of the Flink PMC
Congratulations Jark!
Best,
Jiayi Liao
+1 (binding)!
It is a good thing to enhance our testing work.
Best,
Zhijiang
--
From:Hequn Cheng
Send Time:2019 Nov. 18 (Mon.) 18:22
To:dev
Subject:Re: [VOTE] FLIP-83: Flink End-to-end Performance Testing Framework
+1 (binding
Congratulations Zhu Zhu!
--
From:Congxian Qiu
Send Time:2019 Dec. 16 (Mon.) 10:23
To:dev@flink.apache.org
Subject:Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer
Congrats, Zhu Zhu!
Best,
Congxian
aihua li 于2019年12月16日周一 上午10:
+1, it is really nice to have the N-Ary stream operator which is meaningful in
some scenarios.
best,
Zhijiang
--
From:Jingsong Li
Send Time:2020 Jan. 10 (Fri.) 11:00
To:dev
Subject:Re: [VOTE] FLIP-92: Add N-Ary Stream Operator
Congratulations Yu!
Best,
Zhijiang
--
From:lining jing
Send Time:2020 Feb. 3 (Mon.) 09:52
To:dev
Subject:Re: [ANNOUNCE] Yu Li became a Flink committer
Congratulations Yu, well deserved.
Jared Li 于2020年2月1日周六 下午12:10写道：
> n
.
Let's forward the further solutions on the jira page as Piotr suggested. :)
Best,
Zhijiang
--
From:Piotr Nowojski
Send Time:2020 Jan. 30 (Thu.) 19:29
To:dev ; zhijiang
Subject:Re: connection timeout during shuffle initializ
+1 (binding), we are waiting too long for it. :)
Best,
Zhijiang
--
From:Guowei Ma
Send Time:2020 Feb. 4 (Tue.) 12:34
To:dev
Subject:Re: [VOTE] FLIP-27 - Refactor Source Interface
+1 (non-binding), thanks for driving.
Best
Hi Thomas,
The reason of missing barrier alignment metric is found and I create the ticket
[1] for tracing the progress. I guess it would be fixed soon. Thanks for
reporting this.
[1] https://issues.apache.org/jira/browse/FLINK-15914
Best,
Zhijiang
-6cLRQxJzo6VNQQVxn3hwf9Zqmv5pcb34/edit?usp=sharing
Best,
Zhijiang
--
发件人：Zhijiang(wangzhijiang999)
发送时间：2018年9月11日(星期二) 15:21
收件人：dev
抄 送：dev
主 题：回复：[DISCUSS] Proposal of external shuffle service
Many thanks Till!
I would create a JIRA for this feature and
Thanks for the efficient response till!
Thanks sunjin for the good feedbacks, we will further confirm with the comments
then! :)
--
发件人：Jin Sun
发送时间：2018年11月1日(星期四) 06:42
收件人：dev
抄 送：Zhijiang(wangzhijiang999) ; Nico Kruber
, then we can discussion further.
Best,
Zhijiang
--
发件人：Tao Yangyu
发送时间：2018年11月6日(星期二) 11:01
收件人：dev
主 题：[DISCUSS] Task speculative execution for Flink batch
Hi everyone,
We propose task speculative execution for Flink batch in this
obs.
Best,
Zhijiang
--
发件人：Thomas Weise
发送时间：2018年11月13日(星期二) 13:11
收件人：dev
主 题：Memory size for network buffers
Hi,
I'm trying to understand the intention behind the size parameters for
network buffers, specifically max, min an
three parameters for network memory are more flexible than before
that just config the extract "numberOfBuffers", so it may not be changed again
if we make some improments in future .
Best,
Zhijiang
--
发件人：Thomas Weise
发送时间：
＋1
--
发件人：Maximilian Michels
发送时间：2018年11月26日(星期一) 01:51
收件人：dev
主 题：Re: JIRA notifications
It seems that some people find it useful to receive JIRA mails for new
issues only. The "issues" mailing list gets all JIRA notifications,
.
Wish this feature working in the next major release. :)
Best,
Zhijiang
--
发件人：Till Rohrmann
发送时间：2018年11月5日(星期一) 18:43
收件人：dev
主 题：Re: [DISCUSS]Enhancing flink scheduler by implementing blacklist mechanism
Thanks for sharing this
://issues.apache.org/jira/browse/FLINK-10653
[2]
https://docs.google.com/document/d/1ssTu8QE8RnF31zal4JHM1VaVENow-PweUtXSRr68nGg/edit?usp=sharing
--
发件人：zhijiang
发送时间：2018年11月1日(星期四) 17:19
收件人：dev ; Jin Sun
抄 送：Nico Kruber ; Piotr Nowojski
unification of stream and batch firstly.
Best,
Zhijiang
--
发件人：孙海波
发送时间：2018年12月3日(星期一) 10:52
收件人：dev
主 题：[DISCUSS] Unified Core API for Streaming and Batch
Hi all,
This post proposes unified core API for Streaming and Batch.
Currently
ou might need double check if I understand correctly.
Wish your further feedbacks then I can adjust the docs based on it. Also
welcome any other person's feedbacks!
Best,
Zhijiang
--
发件人：Andrey Zagrebin
发送时间：2018年12月10日(
conclusions which cover not only the first step, but
also all the future extensions described and listed in priority.
BTW, do you think it is necessary that we further co-author a FLIP for this
feature? It is actually involved in many changes on both TM, JM sides. :)
Best,
Zhijiang
& JMGateway for current implementation. Certainly it can also rely on
other ways for different ShuffleManager implementations. I would update the
google doc to make this process clear if you also think so. :)
Best,
Zhij
reflecting the ratio as
backpressure if not affect theperformance.
Best,
Zhijiang
--
From:Piotr Nowojski
Send Time:2019年1月4日(星期五) 17:01
To:dev
Subject:Re: [DISCUSS] Detection Flink Backpressure
Hi,
In that case I think instead o
subpartitions as you required.
Best,
Zhijiang
--
From:Chris Miller
Send Time:2019年1月9日(星期三) 20:46
To:dev
Subject:Request multiple subpartitions of one partition
Hello,
let's image we do a hash join of two DataSources. For the
behaviour, it is better to change the logic or limit in scheduler
instead of network stack. Another simple way for your requirement is setting
only one slot per task manager, then there would be only one task running in
each task manager.
Best,
Zhijiang
task name, then you can get all the
created views from PartitionRequestQueue.
Best,
Zhijiang
--
From:Chris Miller
Send Time:2019年1月12日(星期六) 16:13
To:dev
Subject:Identify the task within PartitionRequestQueue
Hi all,
I just made
suggestions! :)
[1]
https://docs.google.com/document/d/1l7yIVNH3HATP4BnjEOZFkO2CaHf1sVn_DSxS2llmkd8/edit?usp=sharing
Best,
Zhijiang
--
From:zhijiang
Send Time:2018年12月25日(星期二) 15:33
To:Andrey Zagrebin
Cc:dev
Subject:Re: [DISCUSS
://issues.apache.org/jira/browse/FLINK-10653
Best,
Zhijiang
--
From:zhijiang
Send Time:2019年1月15日(星期二) 17:55
To:Andrey Zagrebin
Cc:dev
Subject:Re: [DISCUSS] Proposal of external shuffle service
Hi all,
After continuous discussion with Andrey
Blink/Flink reach the same point, users might use Blink for enjoying some
advantages earily.
So from the user experience aspect, Blink might have to push the changes such
as bug fix before completely merging into Flink. This issue should be concerned
when making the decision.
Best,
Zhijiang
before, which would not change any exiting mechanisms in runtime
and it is easy to control.
Best,
Zhijiang
--
From:Chris Miller
Send Time:2019年1月24日(星期四) 03:04
To:wangzhijiang999
Cc:dev
Subject:Re: Request multiple subpartitions of one
it is natural to solve the above
problems based on this architecuture. You can refer to the flip [1] if
interested.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-31%3A+Pluggable+Shuffle+Manager
Best,
Zhijiang
, and I think it would
solve all your concerns based on this architecuture.
Best,
Zhijiang
--
From:Bo WANG
Send Time:2019年1月28日(星期一) 15:11
To:dev
Cc:wangzhijiang999 ; Kurt Young
Subject:Re: [DISCUSS] Shall we make
specific process for this improvement.
I am in favor of launching a separate thread for this discussion again, thanks
for the advice!
Best,
Zhijiang
--
From:Till Rohrmann
Send Time:2019年1月28日(星期一) 19:14
To:dev ; zhijiang
Cc:Andrey
component in JM
side. You can regard that as a simple and special implementation version. And
the YarnShuffleService can further be refactored within this proposed shuffle
manager architecture.
Best,
Zhijiang
--
From:qi luo
Send
ocs.google.com/document/d/1l7yIVNH3HATP4BnjEOZFkO2CaHf1sVn_DSxS2llmkd8/edit?usp=sharing
[2]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-31%3A+Pluggable+Shuffle+Manager
[3] https://issues.apache.org/jira/browse/FLINK-10653
Best,
Zhijiang
1 - 100 of 384 matches
Mail list logo
