Re: Python Flink cluster: how to shut-down

2021-03-04 Thread Yang Wang
I think chesnay's answer is on the point. You could find how to list and cancel a Flink application on Kubernetes here[1]. Another thing is that please make sure that you are using the correct service exposed type[2]( e.g. LoadBalancer on the cloud, NodePort for the self-managed cluster, or Cluste

Re: Python Flink cluster: how to shut-down

2021-03-04 Thread Chesnay Schepler
run-application creates an application cluster that shuts down once the job is complete. As such, canceling the job in this case is equivalent to shutting down the cluster. AFAIK you also need to specify kubernetes arguments when using the list command. (without any argument it just assumes yo

Python Flink cluster: how to shut-down

2021-03-04 Thread Robert Cullen
I ran this command using the example from the CLI page on the Flink website: $ ./bin/flink run-application \ —target kubernetes-application \ —parallelism 8 \ -Dkubernetes.cluster-id= \ -Dtaskmanager.memory.process.size=4096m \ -Dkubernetes.taskmanager.cpu=2 \ -Dtaskmanager.numberOfTaskSlots=4 \ -