Re: Adding CudaBuffer to pyarrow

2018-09-10 Thread Pearu Peterson
Hi all, Please review the PR for enabling GPU support in pyarrow: https://github.com/apache/arrow/pull/2536 Best regards, Pearu On Wed, Aug 29, 2018 at 6:45 PM, Antoine Pitrou wrote: > > Hi Pearu, > > Your approach seems ok on the principle. Feel free to open a PR once > you have a basic API

Re: Adding CudaBuffer to pyarrow

2018-08-29 Thread Antoine Pitrou
Hi Pearu, Your approach seems ok on the principle. Feel free to open a PR once you have a basic API defined and exposed, so that we can iterate on that. Regards Antoine. Le 29/08/2018 à 17:11, Pearu Peterson a écrit : > Hi Wes, > > Thanks for the hints! > > I have created a very minimal G

Re: Adding CudaBuffer to pyarrow

2018-08-29 Thread Pearu Peterson
Hi Wes, Thanks for the hints! I have created a very minimal GPU support to pyarrow, see https://github.com/apache/arrow/compare/master...Quansight:pearu-cuda-pyarrow?expand=1 This includes: 1. introducing libarrow_gpu that is built into pyarrow.lib_gpu extension module, currently only CudaBuff

Re: Adding CudaBuffer to pyarrow

2018-08-28 Thread Wes McKinney
hi Pearu, Sounds good to me; I had wanted to do it already but got caught up working on other things. You'll probably want to create libarrow_gpu.pxd since this is an optional library. Otherwise it should be reasonably straightforward. some relevant issues - https://issues.apache.org/jira/browse

Adding CudaBuffer to pyarrow

2018-08-28 Thread Pearu Peterson
Hi, Is there any interest in implementing CudaBuffer support in pyarrow? Are there any obstacles that would prevent to do this? I would be willing to give it a try. As I understand, the entry point for this task would be to patch pyarrow/includes/libarrow.pxd . Any hints for what to take into ac