Re: Use case for R Arrow Bindings

2017-07-19 Thread Dean Chen
he bandwidth to take responsibility for > another major component, especially not in an unfamiliar software > development stack. > > Let me know how I can help, and if there are R mailing list > discussions where we (the Arrow developers) can chime in please alert > us to them her

Re: Use case for R Arrow Bindings

2017-07-19 Thread Dean Chen
I also sent a note about it to the dev list a month ago. Still have a huge internal need and interested in helping push this along where we can. Unfortunately, our team is more focused around Spark and doesn't have much experience working with the R community. On Wed, Jul 19, 2017 at 1:44 PM Clark

Re: Improve SparkR collect performance with Arrow

2017-05-15 Thread Dean Chen
sues (I can help some with > > maintaining the C++ side of the bindings) and address packaging / builds > / > > continuous integration. > > > > - Wes > > > > On Sun, May 14, 2017 at 1:26 PM, Dean Chen wrote: > > > >> Following up on the discussio

Improve SparkR collect performance with Arrow

2017-05-14 Thread Dean Chen
Following up on the discussion from https://issues.apache.org/jira/browse/SPARK-18924. We have internal use cases that would benefit significantly from improved collect performance and would like to kick off a similar proposal/effort to https://issues.apache.org/jira/browse/SPARK-13534 for SparkR.