Re: [VOTE][RUST] Release Apache Arrow Rust 36.0.0 RC1

2023-03-24 Thread Wayne Xia
+1, verified on amd64 Linux. Thanks! On Sat, Mar 25, 2023 at 6:00 AM L. C. Hsieh wrote: > +1 (binding) > > Verified on M1 Mac. > > Thank you Raphael. > > On Fri, Mar 24, 2023 at 12:58 PM Andrew Lamb wrote: > > > > +1 (binding) > > > > This is another epic release -- thank you Raphael. > > > >

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread L. C. Hsieh
+1 (binding) Verified on Intel Mac. Thanks Andy. On Fri, Mar 24, 2023 at 11:55 AM Andrew Lamb wrote: > > +1 (binding) > > In terms of [1], it should not block the release in my opinion, but it is a > blemish. > > I would be willing to run the release process for a patch 21.0.1 next week > with

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread Jeremy Dyer
+1 (non-binding) for release building, license, artifacts, and working as I expecting it to [1] is mildly concerning for my use case but I don’t care to just wait a week for 21.0.1 release as I’m not going to be using it until then anyway. Thanks Andy! Jeremy Dyer Get Outlook for iOS

Re: [VOTE][RUST] Release Apache Arrow Rust 36.0.0 RC1

2023-03-24 Thread L. C. Hsieh
+1 (binding) Verified on M1 Mac. Thank you Raphael. On Fri, Mar 24, 2023 at 12:58 PM Andrew Lamb wrote: > > +1 (binding) > > This is another epic release -- thank you Raphael. > > Andrew > > On Fri, Mar 24, 2023 at 3:24 PM Raphael Taylor-Davies > wrote: > > > Hi, > > > > I would like to propos

Re: Arrow/C++14

2023-03-24 Thread Arkadiy Vertleyb (BLOOMBERG/ 120 PARK)
Okay, thanks. Sounds we don't need Run-end encoded arrays. Just took release-9.0.0-rc2 and it seems to be fine with c++14. From: dev@arrow.apache.org At: 03/24/23 16:13:59 UTC-4:00To: dev@arrow.apache.org Subject: Re: Arrow/C++14 Yes, we make sure the data is compatible over time, or at leas

Re: Arrow/C++14

2023-03-24 Thread Will Jones
Yes, we make sure the data is compatible over time, or at least detect that data has new features. Our format versioning is explained here [1]. You can see various additions here [2]. The only one that's newer than 9.0.0 is the Run-end encoded arrays, but those aren't in widespread use yet. [1] ht

Re: [VOTE][RUST] Release Apache Arrow Rust 36.0.0 RC1

2023-03-24 Thread Andrew Lamb
+1 (binding) This is another epic release -- thank you Raphael. Andrew On Fri, Mar 24, 2023 at 3:24 PM Raphael Taylor-Davies wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 36.0.0. > > This release candidate is based on commit: > 71ecc39f36c8f3

Re: Arrow/C++14

2023-03-24 Thread Arkadiy Vertleyb (BLOOMBERG/ 120 PARK)
Thanks Will. Is that version still data-format compatible with today? From: dev@arrow.apache.org At: 03/24/23 15:39:12 UTC-4:00To: dev@arrow.apache.org Subject: Re: Arrow/C++14 That should be Apache Arrow 9.0.0. It was in Arrow 10 that we mandated C++ 17. [1][2] [1] https://arrow.apache.org/

Re: Arrow/C++14

2023-03-24 Thread Will Jones
That should be Apache Arrow 9.0.0. It was in Arrow 10 that we mandated C++ 17. [1][2] [1] https://arrow.apache.org/release/10.0.0.html [2] https://issues.apache.org/jira/browse/ARROW-17545 On Fri, Mar 24, 2023 at 12:27 PM Arkadiy Vertleyb (BLOOMBERG/ 120 PARK) < avertl...@bloomberg.net> wrote: >

Arrow/C++14

2023-03-24 Thread Arkadiy Vertleyb (BLOOMBERG/ 120 PARK)
Hi, What is the latest Arrow version that supports C++14 standard? Thank you, Arkadiy

[VOTE][RUST] Release Apache Arrow Rust 36.0.0 RC1

2023-03-24 Thread Raphael Taylor-Davies
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 36.0.0. This release candidate is based on commit: 71ecc39f36c8f38a5fc93bc3878a607c831b2f12 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please downloa

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread Andrew Lamb
+1 (binding) In terms of [1], it should not block the release in my opinion, but it is a blemish. I would be willing to run the release process for a patch 21.0.1 next week with a fix if that is preferable to making a 21.0.0 RC2 and resetting the release clock for the community. Andrew [1]: htt

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread Raphael Taylor-Davies
I'm neutral on whether this should be a release blocker, but something I noticed when verifying the arrow 36 release candidate is that DataFusion main currently depends on two different versions of arrow-rs, see [1]. Just an FYI [1]: https://github.com/apache/arrow-datafusion/pull/5603/files#r

Re: Zero copy cast kernels

2023-03-24 Thread Rok Mihevc
For scalar casting tests we use CheckCastZeroCopy [1] which you could reuse. [1] https://github.com/apache/arrow/blob/e7d6c13d4ae3d8df0e9b668468b990f35c8a9556/cpp/src/arrow/compute/kernels/scalar_cast_test.cc#L128-L138 Rok

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread Wayne Xia
+1, verified on amd64 Linux Thanks! On Sat, Mar 25, 2023 at 12:17 AM Eduard Karacharov < eduard.karacha...@gmail.com> wrote: > +1 (non-binding) > > Verified on Intel Mac. > > Thanks Andy! > > On Fri, Mar 24, 2023 at 5:16 PM Andy Grove wrote: > > > Hi, > > > > I would like to propose a release o

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread Eduard Karacharov
+1 (non-binding) Verified on Intel Mac. Thanks Andy! On Fri, Mar 24, 2023 at 5:16 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 21.0.0. > > This release candidate is based on commit: > c825c84c223c78184dbd42b070adc1f38d9

Zero copy cast kernels

2023-03-24 Thread Li Jin
Hello, I recently found myself casting an int64 (nanos from epoch) into a nano timestamp column with the C++ cast kernel (via Acero). I expect this to be zero copy but I wonder if there is a way to check which casts are zero copy and which are not? Li

Re: Stacktrace from Arrow status?

2023-03-24 Thread Li Jin
Thanks David! On Tue, Mar 21, 2023 at 6:32 PM David Li wrote: > Not really, other than: > > * By searching the codebase for relevant strings. > * If you are building Arrow from source, you can use the option > ARROW_EXTRA_ERROR_CONTEXT [1] when configuring. This will get you a rough > stack trac

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread vin jake
+1 (non-binding) thanks. On Fri, Mar 24, 2023 at 10:16 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache Arrow DataFusion > Implementation, > version 21.0.0. > > This release candidate is based on commit: > c825c84c223c78184dbd42b070adc1f38d975cf6 [1] > The proposed rel

[VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 21.0.0 RC1

2023-03-24 Thread Andy Grove
Hi, I would like to propose a release of Apache Arrow DataFusion Implementation, version 21.0.0. This release candidate is based on commit: c825c84c223c78184dbd42b070adc1f38d975cf6 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download

Re: [Java][tests] Set-up instructions for TLS tests

2023-03-24 Thread David Li
You should `git submodule update --init` and possibly set the environment variable ARROW_TEST_DATA to $(repo root)/testing/data. (I think the exception raised mentions this, but [1] should definitely describe this.) [1]: https://arrow.apache.org/docs/dev/developers/java/development.html On Thu,