Re: SPIP: Spark on Kubernetes

2017-08-15 Thread Daniel Imberman
+1 (non-binding) Glad to see this moving forward :D On Tue, Aug 15, 2017 at 10:10 AM Holden Karau wrote: > +1 (non-binding) > > I (personally) think that Kubernetes as a scheduler backend should > eventually get merged in and there is clearly a community interested in the > work required to mai

Re: Creating a python port for a Scala Spark Projeect

2016-06-22 Thread Daniel Imberman
k! :) > > On Wed, Jun 22, 2016 at 7:07 PM, Daniel Imberman < > daniel.imber...@gmail.com> wrote: > >> Hi All, >> >> I've developed a spark module in scala that I would like to add a python >> port for. I want to be able to allow users to create a pysp

Creating a python port for a Scala Spark Projeect

2016-06-22 Thread Daniel Imberman
Hi All, I've developed a spark module in scala that I would like to add a python port for. I want to be able to allow users to create a pyspark RDD and send it to my system. I've been looking into the pyspark source code as well as py4J and was wondering if there has been anything like this implem