Refer this post
http://blog.prabeeshk.com/blog/2015/04/07/self-contained-pyspark-application/
On 13 April 2015 at 17:41, Punya Biswal wrote:
> Dear Spark users,
>
> My team is working on a small library that builds on PySpark and is
> organized like PySpark as well -- it has a JVM component (tha
Dear Spark users,
My team is working on a small library that builds on PySpark and is organized
like PySpark as well -- it has a JVM component (that runs in the Spark driver
and executor) and a Python component (that runs in the PySpark driver and
executor processes). What's a good approach for
