Re: FPGA support for Apache Arrow

2019-04-01 Thread Dimitris Lekkas
Alright, I think I understand your suggestion. It's like defining a SharedMemoryPool for example where we implement our desired way of memory allocation (with page-alignment + mem mapping). Thanks! On Mon, Apr 1, 2019 at 1:34 PM Antoine Pitrou wrote: > On Mon, 1 Apr 2019 10:25:26 +0300 > Dimitr

Re: FPGA support for Apache Arrow

2019-04-01 Thread Antoine Pitrou
On Mon, 1 Apr 2019 10:25:26 +0300 Dimitris Lekkas wrote: > Hey Antoine, > > Regarding the C++ side, do you consider variable alignment for buffers > a valuable addition? Would you be interested for such a PR? I think that it you have specific alignment requirements (and perhaps other requirement

Re: FPGA support for Apache Arrow

2019-04-01 Thread Dimitris Lekkas
Hey Antoine, Regarding the C++ side, do you consider variable alignment for buffers a valuable addition? Would you be interested for such a PR? Finally, I want to ask if I should be discussing such issues on Jira instead of dev mailing list. Thanks for the replies, despite you being busy with the

Re: FPGA support for Apache Arrow

2019-03-31 Thread Antoine Pitrou
Hi Dimitris, Le 31/03/2019 à 23:09, Dimitris Lekkas a écrit : > > Correct me if I'm wrong, but it doesn't seem to me that allocating size of > 4KB > multiple would equivalently mean that the starting address of data is also > a > multiple of 4KB. You're right. > For example, in the Java imple

Re: FPGA support for Apache Arrow

2019-03-31 Thread Dimitris Lekkas
ignment of data buffers in Java implementation so if that > sounds > > > > interesting to you we could discuss on that as well. > > > > > > > > Regards, > > > > > > > > Dimitris > > > > > > > > On Fri, Mar 29, 20

Re: FPGA support for Apache Arrow

2019-03-30 Thread Wes McKinney
Dimitris > > > > > > On Fri, Mar 29, 2019 at 6:31 AM Melik-Adamyan, Areg < > > > areg.melik-adam...@intel.com> wrote: > > > > > > > Hi Chris, > > > > > > > > Do you have plans to contribute the infrastructure part back to the &g

Re: FPGA support for Apache Arrow

2019-03-30 Thread Dimitris Lekkas
t; > Hi Chris, > > > > > > Do you have plans to contribute the infrastructure part back to the > > > community so the others can build hybrid pipelines? > > > > > > -Original Message- > > > From: Wes McKinney [mailto:wesmck...@gmail.com] > &g

Re: FPGA support for Apache Arrow

2019-03-29 Thread Wes McKinney
o contribute the infrastructure part back to the > > community so the others can build hybrid pipelines? > > > > -Original Message- > > From: Wes McKinney [mailto:wesmck...@gmail.com] > > Sent: Thursday, March 28, 2019 10:51 AM > > To: dev@arrow.apache.org

Re: FPGA support for Apache Arrow

2019-03-29 Thread Dimitris Lekkas
om] > Sent: Thursday, March 28, 2019 10:51 AM > To: dev@arrow.apache.org > Cc: ch...@inaccel.com > Subject: Re: FPGA support for Apache Arrow > > hi Chris -- in addition to commenting on ARROW-2447, do you want to submit > a PR to add yourself to Powered By? > > https://

RE: FPGA support for Apache Arrow

2019-03-28 Thread Melik-Adamyan, Areg
Subject: Re: FPGA support for Apache Arrow hi Chris -- in addition to commenting on ARROW-2447, do you want to submit a PR to add yourself to Powered By? https://github.com/apache/arrow/blob/master/site/powered_by.md best Wes On Thu, Mar 28, 2019 at 6:01 AM Antoine Pitrou wrote: > > &

Re: FPGA support for Apache Arrow

2019-03-28 Thread Wes McKinney
hi Chris -- in addition to commenting on ARROW-2447, do you want to submit a PR to add yourself to Powered By? https://github.com/apache/arrow/blob/master/site/powered_by.md best Wes On Thu, Mar 28, 2019 at 6:01 AM Antoine Pitrou wrote: > > > Hello Chris, > > Le 28/03/2019 à 11:56, ch...@inacce

Re: FPGA support for Apache Arrow

2019-03-28 Thread Antoine Pitrou
Hello Chris, Le 28/03/2019 à 11:56, ch...@inaccel.com a écrit : > > I would like to let you know that we have released our new version > of our framework that > allows FPGAs to talk to any other framework under Arrow. > > That means that any