They will consume some memory because there are still objects in memory
to be kept around, and some CPU cycles during checkpointing, but overall
the impact should be negligible.
On 6/23/2021 12:39 AM, Jerome Li wrote:
Thanks for the response! Let’s assume some of the Sink does not have
incoming message. Would idle Sink hurt the performance to the other
instances in the same taskmanager? I did explore the CPU and memory
usages for the entire pipeline. When there are not data flowing, the
whole cpu and memory usage went down when there were not data coming
in. When the data flow resume, cpu and memory usage would goes high
again.
Best,
*From: *Chesnay Schepler <ches...@apache.org>
*Date: *Tuesday, June 22, 2021 at 12:57 PM
*To: *Jerome Li <l...@vmware.com>, user@flink.apache.org
<user@flink.apache.org>
*Subject: *Re: Flink Resource Management
No; Flink does not cleanuo idle operators.
On 6/22/2021 9:19 PM, Jerome Li wrote:
Hi and Dear Flink users,
I am new to Flink. My project is using Flink v1.12.4+.
I am curious about how Flink manage the cpu and memory when an
instance of a ProcessFunction/Sink is idle? Will Flink resource
manager take deallocate cpu and memory from it? Because I am
trying to expand the parallelism of a sink to all taskamangers to
avoid large network traffic between taskmanagers
Any help would be appreciated!\
Thanks!
