[RESULT][VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 35.0.0 RC1

2024-01-25 Thread Andy Grove
On Thu, Jan 25, 2024 at 8:33 AM Andy Grove wrote: > The vote passes with three binding +1 votes. Thanks, everyone. > > The release is available at > https://dist.apache.org/repos/dist/release/arrow/arrow-datafusion-35.0.0/ > > On Sun, Jan 21, 2024 at 12:38 PM L. C. Hsieh wrote: > >> +1 (binding)

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 35.0.0 RC1

2024-01-25 Thread Andy Grove
The vote passes with three binding +1 votes. Thanks, everyone. The release is available at https://dist.apache.org/repos/dist/release/arrow/arrow-datafusion-35.0.0/ On Sun, Jan 21, 2024 at 12:38 PM L. C. Hsieh wrote: > +1 (binding) > > Agreed with Andrew. This looks like a test only issue. > I

Re: [Python][Rust] Is Arrow Rust supposed to support S3-compatible storage with non-public certificates?

2024-01-25 Thread Raphael Taylor-Davies
On a related note, version 0.9.0 switched to using the system CAs by default [1], and so if you've added your private CA chain into there it should work. [1]: https://github.com/apache/arrow-rs/pull/5056 On 25 January 2024 09:17:55 GMT, Raphael Taylor-Davies wrote: >The ticket for supporting s

Re: [Python][Rust] Is Arrow Rust supposed to support S3-compatible storage with non-public certificates?

2024-01-25 Thread Raphael Taylor-Davies
The ticket for supporting self-signed certificates can be found here [1]. If you switch the TLS backend to OpenSSL it may respect the SSL_CERT_FILE environment variable, but I'm not very familiar with the particulars of that library. This would require customising the Rust build, however, which

Re: [IPC] Delta Dictionary Flag Clarification for Multi-Batch IPC

2024-01-25 Thread Antoine Pitrou
Hello, My own answers: 1) isDelta should be true only when a delta is being transmitted (to be appended to the existing dictionary with the same id); it should be false when a full dictionary is being transmitted (to replace the existing dictionary with the same id, if any) 2) yes, it coul

[Python][Rust] Is Arrow Rust supposed to support S3-compatible storage with non-public certificates?

2024-01-25 Thread elveshoern32
Since my question remained unanswered on the user list, I dare to ask again on the dev list: While experimenting with polars [1] (which is based on arrow-rs) I found that it's not possible to read a single file from our on-prem S3-compatible storage. Any attempts result in SSL error messages: