Re: [Discuss] C++ query builder/execution API

2023-01-30 Thread Shoumyo Chakravorti (BLOOMBERG/ 731 LEX)
avoiding consolidation of such functionality in the Arrow repos would be in the best interest of the Arrow ecosystem. From: dev@arrow.apache.org At: 01/27/23 13:06:20 UTC-5:00To: dev@arrow.apache.org Subject: Re: [Discuss] C++ query builder/execution API +1 to what Ian said. I'll also add,

Re: [Discuss] C++ query builder/execution API

2023-01-30 Thread Shoumyo Chakravorti (BLOOMBERG/ 731 LEX)
a whole. Thanks again for taking a look and sharing your perspective! From: dev@arrow.apache.org At: 01/27/23 12:10:42 UTC-5:00To: dev@arrow.apache.org Subject: Re: [Discuss] C++ query builder/execution API Hi Shoumyo, This is exciting—thank you for the thoughtfulness you have put into this prop

Re: [Discuss] C++ query builder/execution API

2023-01-27 Thread Weston Pace
+1 to what Ian said. I'll also add, as was brought up in the earlier pandas API discussion, that a blog post (once you've got something ready to use) would be a good idea. > On the other hand, making such an interface readily available alongside > `libarrow` could increase the adoption of Arrow

Re: [Discuss] C++ query builder/execution API

2023-01-27 Thread Ian Cook
Hi Shoumyo, This is exciting—thank you for the thoughtfulness you have put into this proposal. This topic of a C++ dataframe API for Arrow-native engine(s) has come up in the past [3], but the bulk of the previous discussion about this predated Substrait. With the Substrait project now quickly ga