Hi Pankaj, "Running Flink on Kubernetes" refers to the old way that basically deploys a Flink standalone cluster on Kubernetes. We leverage scripts to run Flink Master and TaskManager processes inside Kubernetes container. In this way, Flink is not ware of whether it's running in containers or directly on physical machines, and will not interact with the Kubernetes Master. Flink Master reactively accept all registered TaskManagers, whose number is decided by the Kubernetes replica.
"Running Flink natively on Kubernetes" refers deploy Flink as a Kubernetes Job. Flink Master will interact with Kubernetes Master, and actively requests for pods/containers, like on Yarn/Mesos. Thank you~ Xintong Song On Mon, Mar 16, 2020 at 4:03 PM Pankaj Chand <pankajchanda...@gmail.com> wrote: > Hi all, > > I want to run Flink, Spark and other processing engines on a single > Kubernetes cluster. > > From the Flink documentation, I did not understand the difference between: > (1) Running Flink on Kubernetes, Versus (2) Running Flink natively on > Kubernetes. > > Could someone please explain the difference between the two, and when > would you use which option? > > Thank you, > > Pankaj >
