[VOTE][Format] Variable shape tensor canonical extension type

2023-09-27 Thread Rok Mihevc
Hi all, Following the discussion [1][2] I would like to propose a vote to add variable shape tensor canonical extension type language to CanonicalExtensions.rst [3] as written below. A draft C++ implementation and a Python wrapper can be seen here [2]. The vote will be open for at least 72 hours.

Arrow community meeting September 27 at 16:00 UTC

2023-09-27 Thread Ian Cook
Our next biweekly Arrow community meeting is today at 16:00 UTC / 12:00 EDT. Zoom meeting URL: https://zoom.us/j/87649033008?pwd=SitsRHluQStlREM0TjJVYkRibVZsUT09 Meeting ID: 876 4903 3008 Passcode: 958092 Meeting notes will be captured in this Google Doc: https://docs.google.com/document/d/1xrji8

Re: [DISCUSS][C++] Raw pointer string views

2023-09-27 Thread Benjamin Kietzman
Hello all, @Gang > Could you please simply describe the layout of DuckDB and Velox Arrow represents long (>12 bytes) strings with a view which includes a buffer index (used to look up one of the variadic data buffers) and an offset (used to find the start of a string's bytes within the indicated

Re: [DISCUSS][C++] Raw pointer string views

2023-09-27 Thread Raphael Taylor-Davies
Do you have any benchmarks comparing kernels with native pointer array support, compared to those that must first convert to the offset representation? I think this would help ground this discussion empirically. On 27 September 2023 22:25:02 BST, Benjamin Kietzman wrote: >Hello all, > >@Gang >

Re: [DISCUSS][C++] Raw pointer string views

2023-09-27 Thread Aldrin
Out of curiosity, does any of the hash kernels using raw pointers address your question Raphael?I haven't looked at the original PR so I am likely missing context. My impression is that there is pushback against kernels that use StringView with a raw pointer type? Since the hashing functions con

Re: [VOTE] Release Apace Arrow nanoarrow 0.3.0 - RC0

2023-09-27 Thread Will Jones
+1 (binding) Verified with Conda on MacOS M1. On Tue, Sep 26, 2023 at 6:49 PM Jacob Wujciak-Jens wrote: > +1 (non-binding) > > full verification with conda arrow 13.0.0 R 4.3 on pop_os 23.04, cmake > 3.27, gcc 11 > > On Wed, Sep 27, 2023 at 1:26 AM Bryce Mecum wrote: > > > +1 (non-binding) > >

Re: [VOTE][RUST] Release Apache Arrow Rust Object Store 0.7.1 RC1

2023-09-27 Thread Will Jones
+1 (binding) Verified on M1 Mac. On Tue, Sep 26, 2023 at 11:29 AM Andrew Lamb wrote: > +1 (binding) > > Verified on mac x86_64 > > Looks like a good release to me -- thank you Raphael > > Andrew > > On Tue, Sep 26, 2023 at 12:05 PM Raphael Taylor-Davies > wrote: > > > Hi, > > > > I would like