Thanks for the response! Let’s assume some of the Sink does not have incoming message. Would idle Sink hurt the performance to the other instances in the same taskmanager? I did explore the CPU and memory usages for the entire pipeline. When there are not data flowing, the whole cpu and memory usage went down when there were not data coming in. When the data flow resume, cpu and memory usage would goes high again.
Best, From: Chesnay Schepler <ches...@apache.org> Date: Tuesday, June 22, 2021 at 12:57 PM To: Jerome Li <l...@vmware.com>, user@flink.apache.org <user@flink.apache.org> Subject: Re: Flink Resource Management No; Flink does not cleanuo idle operators. On 6/22/2021 9:19 PM, Jerome Li wrote: Hi and Dear Flink users, I am new to Flink. My project is using Flink v1.12.4+. I am curious about how Flink manage the cpu and memory when an instance of a ProcessFunction/Sink is idle? Will Flink resource manager take deallocate cpu and memory from it? Because I am trying to expand the parallelism of a sink to all taskamangers to avoid large network traffic between taskmanagers Any help would be appreciated!\ Thanks!
