Re: question regarding flink local buffer pool

2021-01-06 Thread Arvid Heise
Hi Eleanore, first I'd like to point to a related blog post, which explains most concepts in a better way than I could write here [1]. Now let's go through your questions: 1. A buffer pool is just a place where a task gets a buffer from. So pool-A is used by taskA for both reading (from network

question regarding flink local buffer pool

2021-01-05 Thread Eleanore Jin
Hi experts, I am running flink 1.10, the flink job is stateless. I am trying to understand how local buffer pool works: 1. lets say taskA and taskB both run in the same TM JVM, each task will have its own local buffer pool, and taskA will write to pool-A, and taskB will read from pool-A and write