Re: Flink task manager PODs autoscaling - K8s installation

2025-05-13 Thread Zhanghao Chen
Hi Kamal, Autoscaling consists of two parts: 1. policy: when should we scale up/down the job and for how much? 2. mechanism: how to rescale the job. The adaptive scheduler just gives you the mechanism part, which allows rescaling the job without kill-and-start the whole job. You shall use it to

Re: Apache Flink Serialization Question

2025-05-13 Thread Zhanghao Chen
Flink still use PojoSerializer for the class while only using Kryo for the UUID field. Best, Zhanghao Chen From: Richard Cheung Sent: Wednesday, May 14, 2025 3:21 To: user@flink.apache.org Subject: Apache Flink Serialization Question Hi all! I have a question

Apache Flink Serialization Question

2025-05-13 Thread Richard Cheung
Hi all! I have a question about serialization of POJO data classes in Apache Flink v1.8 (Java). Here's some context: One of my data classes was initially not POJO compatible as it had final fields and no no-arg constructor. I removed the final modifiers and added a no-arg constructor, and confirm

Re: Flink task manager PODs autoscaling - K8s installation

2025-05-13 Thread Nikola Milutinovic
You can definitely run Flink in native Kubernetes mode without K8s Operator. Although, it should be easier to deploy such a cluster with the operator. Operator will just make the process easer. Nix. From: Kamal Mittal via user Date: Tuesday, May 13, 2025 at 3:59 AM To: Kamal Mittal , user@flin