Hi Ufuk,
Thank you for your instant reply and I have got the basic idea.
I am researching flink code now, and if I have further specific
questions next time, I will send to dev@flink.a.o .
Best wishes,
Zhijiang Wang
---
Good to hear. Answers to your questions are inline.
I think we should move the discussion to the dev@flink.a.o list though if
there are more questions.
On Mon, Aug 10, 2015 at 9:29 AM, wangzhijiang999 wrote:
> Hi Ufuk,
>
>
>Thank you for your detail and clear explaination! I reviewed t
Hi Ufuk,
Thank you for your detail and clear explaination! I reviewed the code
based on your info and got it clearly.
For local transfer: When producer emits results to ResultPartition, it will
request Buffer from the pool. If there are no available Buffer, it will wait
.The ResultPart
Hey Zhijiang Wang,
I will update the docs next week with more information. The short version is
that flow control happens via the buffer pools that Flink uses for produced and
consumed intermediate results.
The slightly ;) longer version:
Each task has buffer pools. The size of these buffer po
As said in apache page, Flink's streaming runtime has natural flow control:
Slow downstream operators backpressure faster upstream operators.How to
understand the flink natural flow control? As i know, heron has the
backpressure mechanism, if some tasks process slowly, it will stop reading from
