Re: FPGA support for Apache Arrow

2019-04-01 Thread Dimitris Lekkas
26 +0300 > Dimitris Lekkas wrote: > > Hey Antoine, > > > > Regarding the C++ side, do you consider variable alignment for buffers > > a valuable addition? Would you be interested for such a PR? > > I think that it you have specific alignment requirements (and perhaps

Re: FPGA support for Apache Arrow

2019-04-01 Thread Dimitris Lekkas
the release of 0.13.0. Dimitris On Mon, Apr 1, 2019 at 12:15 AM Antoine Pitrou wrote: > > Hi Dimitris, > > Le 31/03/2019 à 23:09, Dimitris Lekkas a écrit : > > > > Correct me if I'm wrong, but it doesn't seem to me that allocating size > of > > 4KB &g

Re: FPGA support for Apache Arrow

2019-03-31 Thread Dimitris Lekkas
oundaries. > > - Wes > > On Sat, Mar 30, 2019 at 10:20 AM Dimitris Lekkas > wrote: > > > > Hi, > > > > Basically, fletcher has emphasized on reading an Arrow schema and > > generating a > > hardware interface along with a template for the func

Re: FPGA support for Apache Arrow

2019-03-30 Thread Dimitris Lekkas
hub.com/johanpel/fletcher > > There's a risk of some fragmentation of efforts if we end up with > multiple third parties doing this work in isolation; I hope that some > collaborations are able to take place inside Apache Arrow > > - Wes > > On Fri, Mar 29, 2019 at 4:27

[jira] [Created] (ARROW-5069) Implement direct support for shared memory arrow columns

2019-03-29 Thread Dimitris Lekkas (JIRA)
Dimitris Lekkas created ARROW-5069: -- Summary: Implement direct support for shared memory arrow columns Key: ARROW-5069 URL: https://issues.apache.org/jira/browse/ARROW-5069 Project: Apache Arrow

Re: FPGA support for Apache Arrow

2019-03-29 Thread Dimitris Lekkas
Hello, 1) Wes the PR is already submitted and awaiting review. 2) Antoine, you will have feedback from us on the issue shortly. 3) Melik, we plan to contribute back to the Arrow community. Particularly, we are working on tweaking plasma to support allocations enabling fast interaction with FPGAs.

Re: Page-aligned Data Buffers in Java

2019-03-20 Thread Dimitris Lekkas
r then using a > MemoryPool implementation that always aligns to 4KB boundaries (instead of > the 64 byte boundaries the default one does today [1])? > > Thanks, > Micah > > [1] > > https://github.com/apache/arrow/blob/master/cpp/src/arrow/memory_pool.cc#L40 > > On Wed, M

Page-aligned Data Buffers in Java

2019-03-20 Thread Dimitris Lekkas
Hello folks, I am working at Inaccel where we utilize FPGAs to accelerate machine learning workloads . Recently, we wanted to integrate our platform with Arrow and we stumbled upon the non-alignment of data-buffers to page boundaries (4KB). We implemented the option to supply per-column metadata t