Re: FPGA support for Apache Arrow

2019-04-01 Thread Dimitris Lekkas
Alright, I think I understand your suggestion. It's like defining a SharedMemoryPool for example where we implement our desired way of memory allocation (with page-alignment + mem mapping). Thanks! On Mon, Apr 1, 2019 at 1:34 PM Antoine Pitrou wrote: > On Mon, 1 Apr 2019 10:25:26 +0300 > Dimitr

Re: FPGA support for Apache Arrow

2019-04-01 Thread Antoine Pitrou
On Mon, 1 Apr 2019 10:25:26 +0300 Dimitris Lekkas wrote: > Hey Antoine, > > Regarding the C++ side, do you consider variable alignment for buffers > a valuable addition? Would you be interested for such a PR? I think that it you have specific alignment requirements (and perhaps other requirement

Re: FPGA support for Apache Arrow

2019-04-01 Thread Dimitris Lekkas
Hey Antoine, Regarding the C++ side, do you consider variable alignment for buffers a valuable addition? Would you be interested for such a PR? Finally, I want to ask if I should be discussing such issues on Jira instead of dev mailing list. Thanks for the replies, despite you being busy with the

Re: FPGA support for Apache Arrow

2019-03-31 Thread Antoine Pitrou
Hi Dimitris, Le 31/03/2019 à 23:09, Dimitris Lekkas a écrit : > > Correct me if I'm wrong, but it doesn't seem to me that allocating size of > 4KB > multiple would equivalently mean that the starting address of data is also > a > multiple of 4KB. You're right. > For example, in the Java imple

Re: FPGA support for Apache Arrow

2019-03-31 Thread Dimitris Lekkas
ignment of data buffers in Java implementation so if that > sounds > > > > interesting to you we could discuss on that as well. > > > > > > > > Regards, > > > > > > > > Dimitris > > > > > > > > On Fri, Mar 29, 20

Re: FPGA support for Apache Arrow

2019-03-30 Thread Wes McKinney
Dimitris > > > > > > On Fri, Mar 29, 2019 at 6:31 AM Melik-Adamyan, Areg < > > > areg.melik-adam...@intel.com> wrote: > > > > > > > Hi Chris, > > > > > > > > Do you have plans to contribute the infrastructure part back to the &g

Re: FPGA support for Apache Arrow

2019-03-30 Thread Dimitris Lekkas
t; > Hi Chris, > > > > > > Do you have plans to contribute the infrastructure part back to the > > > community so the others can build hybrid pipelines? > > > > > > -Original Message- > > > From: Wes McKinney [mailto:wesmck...@gmail.com] > &g

Re: FPGA support for Apache Arrow

2019-03-29 Thread Wes McKinney
o contribute the infrastructure part back to the > > community so the others can build hybrid pipelines? > > > > -Original Message- > > From: Wes McKinney [mailto:wesmck...@gmail.com] > > Sent: Thursday, March 28, 2019 10:51 AM > > To: dev@arrow.apache.org

Re: FPGA support for Apache Arrow

2019-03-29 Thread Dimitris Lekkas
om] > Sent: Thursday, March 28, 2019 10:51 AM > To: dev@arrow.apache.org > Cc: ch...@inaccel.com > Subject: Re: FPGA support for Apache Arrow > > hi Chris -- in addition to commenting on ARROW-2447, do you want to submit > a PR to add yourself to Powered By? > > https://

RE: FPGA support for Apache Arrow

2019-03-28 Thread Melik-Adamyan, Areg
Subject: Re: FPGA support for Apache Arrow hi Chris -- in addition to commenting on ARROW-2447, do you want to submit a PR to add yourself to Powered By? https://github.com/apache/arrow/blob/master/site/powered_by.md best Wes On Thu, Mar 28, 2019 at 6:01 AM Antoine Pitrou wrote: > > &

Re: FPGA support for Apache Arrow

2019-03-28 Thread Wes McKinney
hi Chris -- in addition to commenting on ARROW-2447, do you want to submit a PR to add yourself to Powered By? https://github.com/apache/arrow/blob/master/site/powered_by.md best Wes On Thu, Mar 28, 2019 at 6:01 AM Antoine Pitrou wrote: > > > Hello Chris, > > Le 28/03/2019 à 11:56, ch...@inacce

Re: FPGA support for Apache Arrow

2019-03-28 Thread Antoine Pitrou
Hello Chris, Le 28/03/2019 à 11:56, ch...@inaccel.com a écrit : > > I would like to let you know that we have released our new version > of our framework that > allows FPGAs to talk to any other framework under Arrow. > > That means that any

FPGA support for Apache Arrow

2019-03-28 Thread chris
Hi, I would like to let you know that we have released our new version of our framework that allows FPGAs to talk to any other framework under Arrow. That means that any Arrow-based framework can utilize now FPGAs in order to speedup their