Hi, Guowei Ma. As far as I know, flink writes some in-memory data to disk when memory is running low. I noticed that flink uses ExternalSorterBuilder for batch operations in the org.apache.flink.runtime.operator.sort package, but I'm curious to confirm if this technique is also used in stream mode. Thank you.
Best, Roc At 2021-03-24 15:01:48, "Guowei Ma" <guowei....@gmail.com> wrote: Hi, Roc Could you explain more about your question? Best, Guowei On Wed, Mar 24, 2021 at 2:47 PM Roc Marshal <flin...@126.com> wrote: Hi, Can someone tell me where flink uses memory spilling to write to disk? Thank you. Best, Roc.