Re: Can I run Spark executors in a Hadoop cluster from a Kubernetes container

2020-04-20 Thread ZHANG Wei
il 16, 2020 20:26 To: user Subject: Can I run Spark executors in a Hadoop cluster from a Kubernetes container Hi, I want to deploy Spark client in a Kubernetes container. Further on , I want to run the spark job in a Hadoop cluster (meaning the resources of the Hadoop cluster will be leveraged

Can I run Spark executors in a Hadoop cluster from a Kubernetes container

2020-04-16 Thread mailfordebu
Hi, I want to deploy Spark client in a Kubernetes container. Further on , I want to run the spark job in a Hadoop cluster (meaning the resources of the Hadoop cluster will be leveraged) but call it from the K8S container. My question is whether this mode of implementation possible? Do let me kno