Re: Running Beam Pipelines on a Flink Application Mode Cluster

2021-02-02 Thread Yang Wang
Hi Jan, If you could run your Apache Beam application with Flink session mode, then it could also work in application mode. The key difference for application mode is that the job submission happens in the JobManager pod, not at the Flink client side. If you want to use the standalone application

Running Beam Pipelines on a Flink Application Mode Cluster

2021-02-01 Thread Jan Bensien
Hello, I am currently trying to run my Apache Beam applications using Flink as my backend. Currently i use a session cluster running on Kubernetes. Is it possible to run Beam pipelines using the application mode? I would like to change to application mode, as I currently benchmark my applicat