If you are looking for a Spark scheduler that runs on top of Kubernetes then
this is the way to go:
https://github.com/apache/spark/blob/master/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesClusterSchedulerBackend.scala
You can also have a look
Yes Yinan I’m looking for a Scala program which submits a Spark job to a
k8s cluster by running spark-submit programmatically
On Wednesday, April 4, 2018, Yinan Li wrote:
> Hi Kittu,
>
> What do you mean by "a Scala program"? Do you mean a program that submits
> a Spark job to a k8s cluster by r
yes “REST application that submits a Spark job to a k8s cluster by running
spark-submit programmatically” and also would like to expose as a
Kubernetes service so that clients can access as any other Rest api
On Wed, Apr 4, 2018 at 12:25 PM Yinan Li wrote:
> Hi Kittu,
>
> What do you mean by "a
Hi Kittu,
What do you mean by "a Scala program"? Do you mean a program that submits a
Spark job to a k8s cluster by running spark-submit programmatically, or
some example Scala application that is to run on the cluster?
On Wed, Apr 4, 2018 at 4:45 AM, Kittu M wrote:
> Hi,
>
> I’m looking for a
