So i've been working on some very very early stage apache arrow integration. My current plan it to emulate some of how the R function execution works. If there are any other people working on similar efforts it would be good idea to combine efforts.
I can see how much effort is involved in converting that PR to a spark package so that people can try to use it. I think this is something that we want some more community iteration on maybe? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Python-Spark-Improvements-forked-from-Spark-Improvement-Proposals-tp19422p19670.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org