Re: Flink Kubernetes Operator Scale Issue

2023-04-27 Thread Gyula Fóra
Hi! It’s currently not possible to run the operator in parallel by simply adding more replicas. However there are different things you can do to scale both vertically and horizontally. First of all you can run multiple operators each watching different set of namespaces to partition the load. Th

Flink Kubernetes Operator Scale Issue

2023-04-27 Thread Talat Uyarer via user
Hi All, We are using Flink Kubernetes Operator on our production. We have 3k+ jobs in standalone mode. But after 2.5k jobs operator getting slow. Now when we submit a job it takes 10+ minutes to the job runs. Does anyone use similar scale or more job ? Now we run as a single pod. Does operator su