Re: Using arrow to efficiently transfer data from Python to R

2019-01-11 Thread Wes McKinney
It would be very useful to be able to pass objects both directions in memory "by pointer". I had opened https://issues.apache.org/jira/browse/ARROW-3750 previously. It may be that what you've done is already the right way, but feel free to open a pull request and we can have a look cheers Wes On

Re: Using arrow to efficiently transfer data from Python to R

2019-01-11 Thread Romain Francois
This is exactly (IMO) the kind of things this project is about. Thanks for looking into that, I'll try to incorporate the idea in the R package asap. Did you look at the reverse operation, i.e. promote an arrow object from R to python ? Romain > Le 11 janv. 2019 à 06:54, Jeffrey Wong a écrit

Using arrow to efficiently transfer data from Python to R

2019-01-10 Thread Jeffrey Wong
Hello, I wanted to share a great experience I had with arrow, Python and R, and possible contribute a package I wrote. I work with many colleagues that build engineering systems in python. As a data scientist I work almost entirely in R and Rcpp. To bridge the engineering work with data science wo