Re: Job Cluster on Kubernetes with PyFlink

2020-07-28 Thread Shuiqiang Chen
Hi Wojciech, After double checking, there should be a way to run PyFlink jobs on kubernetes in the job cluster. You can have a try: 1. The custom image has a corresponding pyflink installed. (it seems that you have already done this) 2. If you use third-party python dependencies in the Python UDF,

Re: Job Cluster on Kubernetes with PyFlink

2020-07-28 Thread Shuiqiang Chen
Hi Wojciech, Currently, we are not able to deploy a job cluster for PyFlink jobs on kubernetes, but it will be supported in release-1.12. Best, Shuiqiang

Job Cluster on Kubernetes with PyFlink

2020-07-28 Thread Wojciech KorczyƄski
Hello, I would like to use PyFlink jobs on Kubernetes in Job Cluster. I managed to do this in Cluster Session mode but deploying it as an independent Job Cluster for each job seems a better option for me. If I understand the documentation well [1], [2] I should create a custom docker image which