Re: Question regarding scope of Arrow

2017-10-04 Thread paddy horan
Thank you both for your thoughts, really appreciated. Get Outlook for iOS<https://aka.ms/o0ukef> From: Siddharth Teotia Sent: Thursday, October 5, 2017 1:15:02 AM To: dev@arrow.apache.org Subject: Re: Question regarding scope of Arrow I think it's a g

Re: Question regarding scope of Arrow

2017-10-04 Thread Siddharth Teotia
I think it's a good idea to have SIMD support inbuilt in Arrow libraries. Simple analytic operations like SUM, MIN, MAX, COUNT, AVG, FILTER (especially for fixed width values and dictionary encoded columns) can be made substantially faster by providing APIs that internally use SIMD (probably throug

Re: Question regarding scope of Arrow

2017-10-04 Thread Wes McKinney
hi Paddy, Thanks for bringing this up. Some responses inline On Wed, Oct 4, 2017 at 10:31 PM, paddy horan wrote: > Hi All, > > I’m hoping someone on this list can comment on the scope of Arrow. In the > interview with Wes for O’Reilly he spoke about an “operator kernel library”. > On the hom

Question regarding scope of Arrow

2017-10-04 Thread paddy horan
Hi All, I’m hoping someone on this list can comment on the scope of Arrow. In the interview with Wes for O’Reilly he spoke about an “operator kernel library”. On the homepage it states that Arrow “enables execution engines to take advantage of the latest SIMD…”. Is this “operator kernel libr