Re: Session mode on Kubernetes and # of TMs

2021-05-11 Thread 김영우
Hi Yangze, Thank you. That's what I'm looking for. And FLINK-15959 is similar to my given requirements. I hope to run queries 'interactively' but if there are insufficient slots, time for spinning up new TMs is needed. Thanks, Youngwoo On Tue, May 11, 2021 at 3:36 PM Yangze Guo wrote: > Hi, Y

Re: Session mode on Kubernetes and # of TMs

2021-05-10 Thread Yangze Guo
Hi, Youngwoo In K8S session, the number of TMs depends on how many slots your job needs and the number of slots per task managers (config key: taskmanager.numberOfTaskSlots). In this case, # of TM = Ceil(total slots need / taskmanager.numberOfTaskSlots) How many your job's topology and parallel

Session mode on Kubernetes and # of TMs

2021-05-10 Thread 김영우
Hi, I have deployed a cluster with session mode on kubernetes and I can see one deployment, services and one JM. I'm trying to run a SQL query through sql client. for instance, 'INSERT INTO ... SELECT ...;' When I run the query in cli, the Flink session is spinning up a TM for the query and then