Can we add out of ASF packages to our APT/Yum repositories?

2022-07-03 Thread Sutou Kouhei
Hi, I'm developing the C API for DataFusion: https://github.com/datafusion-contrib/datafusion-c/ DataFusion itself is developed by ASF but the C API isn't developed by ASF. Because it's developed under https://github.com/datafusion-contrib/ . I want to create .deb/.rpm of the C API for DataFusio

Re: [RUST][DISCUSS] Donate object_store_rs to Arrow

2022-07-03 Thread Andy Grove
Apologies for being late to the discussion but I was busy at Data & AI summit last week. I am supportive of this initiative even though I have not been following this very closely. Thank you Andrew and Raphael for driving this innovation. Andy. On Wed, Jun 29, 2022 at 11:40 AM Raphael Taylor-Dav

Re: Cpp Win32/MSVC build

2022-07-03 Thread James Duong
Hi Arkadiy Vertleyb, I saw your PR (https://github.com/apache/arrow/pull/13376) had closed a couple of weeks ago and there haven't been comments in JIRA for awhile as well. Were you still planning to work on this? I'd be interested in helping to finish this off in either case. On Tue, Jun 7, 2022

Re: accessing Substrait protobuf Python classes from PyArrow

2022-07-03 Thread Yaron Gvili
Thanks, the Google protobuf exposure concerns are clear. Another concern would be consistent maintenance of the same version of Substrait protobuf used in Arrow C++ and in PyArrow. I didn't mean access to users but internally. That is, I didn't mean to expose Substrait protobuf Python classes t

Re: accessing Substrait protobuf Python classes from PyArrow

2022-07-03 Thread Antoine Pitrou
I agree that giving direct access to protobuf classes is not Arrow's job. You can probably take the upstream (i.e. Substrait's) protobuf definitions and compile them yourself, using whatever settings required by your project. Regards Antoine. Le 03/07/2022 à 21:16, Jeroen van Straten a é

Re: accessing Substrait protobuf Python classes from PyArrow

2022-07-03 Thread Jeroen van Straten
It's not so much about whether or not we *can*, but about whether or not we *should* generate and expose these files. Fundamentally, Substrait aims to be a means to connect different systems together by standardizing some interchange format. Currently that happens to be based on protobuf, so *one*

Re: [VOTE] Accept donation of Flight SQL JDBC driver

2022-07-03 Thread Micah Kornfield
+1 Binding. On Sat, Jul 2, 2022 at 5:29 AM David Li wrote: > Done! Thanks Kou, I had thought that was auto-generated. > > On Thu, Jun 30, 2022, at 16:55, Sutou Kouhei wrote: > > +1 > > > >> [2]: > https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/arrow-flight-sql-jdbc-

Re: accessing Substrait protobuf Python classes from PyArrow

2022-07-03 Thread Yaron Gvili
I looked into the Arrow build system some more. It is possible to get the Python classes generated by adding "--python-out" flag (set to a directory created for it) to the `${ARROW_PROTOBUF_PROTOC}` command under `macro(build_substrait)` in `cpp/cmake_modules/ThirdpartyToolchain.cmake`. However