Re: Faster PySpark UDFs using Apache Arrow in Spark 2.3.0

2017-11-08 Thread Jacques Nadeau
Totally awesome. Nice job Li and everyone else! On Mon, Oct 30, 2017 at 2:22 PM, Phillip Cloud wrote: > Congrats Li! This is awesome. > > On Mon, Oct 30, 2017 at 2:05 PM Wes McKinney wrote: > > > hi all, > > > > One of our newest committers, Li Jin, has been driving efforts to > > speed up Pyth

Re: Faster PySpark UDFs using Apache Arrow in Spark 2.3.0

2017-10-30 Thread Phillip Cloud
Congrats Li! This is awesome. On Mon, Oct 30, 2017 at 2:05 PM Wes McKinney wrote: > hi all, > > One of our newest committers, Li Jin, has been driving efforts to > speed up Python UDFs in Spark using Arrow. This was just written about > today: > > > https://databricks.com/blog/2017/10/30/introdu