Re: [DataFusion] Introduce qualified alias expressions

2023-11-08 Thread Jeremy Dyer
>From an Arrow Datafusion Python consumer standpoint this would make using >datafusion so so much easier. Can’t speak to the ramifications to upstream or >other projects but would love to see this and help if needed Thanks, Jeremy Dyer Get Outlook for iOS

Re: [VOTE] Release Apache Arrow ADBC 0.8.0 - RC0

2023-11-08 Thread David Li
With 3 binding and 2 non-binding +1 votes and no -1 votes, the vote passes. I'll begin on the post-release tasks. On Tue, Nov 7, 2023, at 14:01, Dane Pitkin wrote: > +1 (non-binding) > > Verified on M1 MacOS 13 with: > > USE_CONDA=1 TEST_YUM=0 TEST_APT=0 ./dev/release/verify-release-candidate.sh

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 33.0.0 RC1

2023-11-08 Thread Andrew Lamb
As a follow up here, I am working on an arrow 48.0.1 patch release [1] to fix some outstanding issues and unblock the DataFusion 33.0.0 release. Please comment on the ticket if you have any questions or other things you would like to include in the release. Otherwise I plan to make a RC tomorrow [

[VOTE][FORMAT] Bulk ingestion support for Flight SQL

2023-11-08 Thread David Li
Hello, Joel Lubi has proposed adding bulk ingestion support to Arrow Flight SQL [1]. This provides a path for uploading an Arrow dataset to a Flight SQL server to create or append to a table, without having to know the specifics of the SQL or Substrait support on the server. The functionality m

Re: [DISCUSS][MATLAB] Proposal for incremental point releases of the MATLAB interface

2023-11-08 Thread Kevin Gurney
Hi Kou and Dewey, Thank you very much for your very thorough and detailed responses to all of our questions. This is extremely valuable feedback and the points that you made make alot of sense. Sarah and I talked this over a bit more and we think that sticking with the overall apache/arrow pro

[DISCUSS] [DataFusion] Unify Function Interface (remove BuiltInScalarFunction)

2023-11-08 Thread Andrew Lamb
I would like to bring wider visibility to a proposal[1] to unify the function interface in DataFusion. The TLDR is to remove BuiltInScalarFunction and ensure all functions can implemented as `ScalarUDF` There is a small API change to ScalarUDF proposed as well[2]. If you are interested, please l

CVE-2023-47248: PyArrow, PyArrow: Arbitrary code execution when loading a malicious data file

2023-11-08 Thread Antoine Pitrou
Severity: critical Affected versions: - PyArrow 0.14.0 through 14.0.0 - PyArrow 0.14.0 through 14.0.0 Description: Deserialization of untrusted data in IPC and Parquet readers in PyArrow versions 0.14.0 to 14.0.0 allows arbitrary code execution. An application is vulnerable if it reads Arrow

Re: [RESULT][VOTE] Release Apache Arrow 14.0.0 - RC2

2023-11-08 Thread Raúl Cumplido
Thanks Kou! All the post-release tasks I usually do have been finished for 14.0.0: [Done] Update the released milestone Date and set to "Closed" on GitHub [Done] Merge changes on release branch to maintenance branch for patch releases [Done] Add the new release to the Apache Reporter System [Done]

Re: [RESULT][VOTE] Release Apache Arrow 14.0.0 - RC2

2023-11-08 Thread Sutou Kouhei
Hi, > [TODO] Upload RubyGems I've done this because I need this for Apache Arrow Flight SQL adapter for PostgreSQL. Thanks, -- kou In "Re: [RESULT][VOTE] Release Apache Arrow 14.0.0 - RC2" on Mon, 6 Nov 2023 19:01:15 +0100, Raúl Cumplido wrote: > Hi, > > I am currently working on the