Re: Imbalance in Garbage Collection for TaskManagers

2023-02-16 Thread Meghajit Mazumdar
Hi Weihua,Shammon > What kind of session cluster are you using? Standalone or Native? We are running a native deployment on Kubernetes. Is there any optimization we can do ? > Maybe you need to dump memory and analyze the usage if there are no other obvious problems I was thinking of enabling tas

Re: Imbalance in Garbage Collection for TaskManagers

2023-02-16 Thread Shammon FY
Hi Maybe you need to dump memory and analyze the usage if there are no other obvious problems Best, Shammon On Fri, Feb 17, 2023 at 10:41 AM Weihua Hu wrote: > Hi, Meghajit > > What kind of session cluster are you using? Standalone or Native? > If it's standalone, maybe you can check if TaskMa

Re: Imbalance in Garbage Collection for TaskManagers

2023-02-16 Thread Weihua Hu
Hi, Meghajit What kind of session cluster are you using? Standalone or Native? If it's standalone, maybe you can check if TaskManager with heavy gc is running more tasks than others. If so, we can enable "cluster.evenly-spread-out-slots=true" to balance tasks in all task managers. Best, Weihua

Imbalance in Garbage Collection for TaskManagers

2023-02-16 Thread Meghajit Mazumdar
Hello, We have a Flink session cluster deployment in Kubernetes of around 100 TaskManagers. It processes around 20-30 Kafka Source jobs at the moment. The jobs run are all using the same jar and only differ in the SQL query used and other UDFs. We are using the official flink:1.14.3 image. We obs