Re: [VOTE][RUST] Release Apache Arrow Rust 26.0.0 RC1

2022-10-28 Thread QP Hou
+1 (binding) On Fri, Oct 28, 2022 at 10:11 PM L. C. Hsieh wrote: > > +1 (binding) > > Verified on M1 Mac. > > Thanks Andrew! > > On Fri, Oct 28, 2022 at 9:18 PM Raphael Taylor-Davies > wrote: > > > > +1 (binding) > > > > On 29/10/2022 09:13, Andrew Lamb wrote: > > > Hi, > > > > > > I would like

Re: [VOTE][RUST] Release Apache Arrow Rust 26.0.0 RC1

2022-10-28 Thread L. C. Hsieh
+1 (binding) Verified on M1 Mac. Thanks Andrew! On Fri, Oct 28, 2022 at 9:18 PM Raphael Taylor-Davies wrote: > > +1 (binding) > > On 29/10/2022 09:13, Andrew Lamb wrote: > > Hi, > > > > I would like to propose a release of Apache Arrow Rust Implementation, > > version 26.0.0. > > > > This relea

Re: [VOTE][RUST] Release Apache Arrow Rust 26.0.0 RC1

2022-10-28 Thread Raphael Taylor-Davies
+1 (binding) On 29/10/2022 09:13, Andrew Lamb wrote: Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 26.0.0. This release candidate is based on commit: 779804317d9c9d80e72a955deb8594eb45a8308a [1] The proposed release tarball and signatures are hosted at [2]

Proposal for C Data Interface Integration testing

2022-10-28 Thread Matt Topol
Hey all! Given various discussions about our testing and the C Data Interface, I've put together a small proposal for developing the integration testing for the C Data interface. For the most part it's an extension of Archery and the way Archery's integration testing works. I've put it into a Goog

Re: [ANNOUNCE] New Arrow committer: Will Jones

2022-10-28 Thread Andrew Lamb
Congratulations Will On Fri, Oct 28, 2022 at 10:21 AM Nic wrote: > Fantastic, congratulations Will! > > On Fri, 28 Oct 2022 at 10:52, Raúl Cumplido > wrote: > > > Congratulations Will! > > > > El vie, 28 oct 2022 a las 11:46, Antoine Pitrou () > > escribió: > > > > > > > > Welcome Will, and tha

Re: [ANNOUNCE] New Arrow committer: Eric Patrick Hanson

2022-10-28 Thread Andrew Lamb
Congratulations! On Thu, Oct 27, 2022 at 4:20 PM Joris Van den Bossche < jorisvandenboss...@gmail.com> wrote: > Congratulations, and welcome Eric! > > On Thu, 27 Oct 2022 at 13:53, Eric Hanson wrote: > > > > thanks, I'm excited to join! > > > > On 2022/10/26 21:38:53 Sutou Kouhei wrote: > > > On

[VOTE][RUST] Release Apache Arrow Rust 26.0.0 RC1

2022-10-28 Thread Andrew Lamb
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 26.0.0. This release candidate is based on commit: 779804317d9c9d80e72a955deb8594eb45a8308a [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, ve

Re: [DISCUSS] Move issue tracking to

2022-10-28 Thread Neal Richardson
I created an umbrella issue to track this and other decisions and tasks we have to make this switch happen: https://github.com/apache/arrow/issues/14542 Please comment (or edit if you can) freely. Neal On Wed, Oct 26, 2022 at 3:39 PM Ian Cook wrote: > I updated this user mapping list to includ

Re: [ANNOUNCE] New Arrow committer: Will Jones

2022-10-28 Thread Nic
Fantastic, congratulations Will! On Fri, 28 Oct 2022 at 10:52, Raúl Cumplido wrote: > Congratulations Will! > > El vie, 28 oct 2022 a las 11:46, Antoine Pitrou () > escribió: > > > > > Welcome Will, and thanks for your contributions! > > > > > > Le 28/10/2022 à 01:56, Sutou Kouhei a écrit : > >

Re: measuring memory usage of Arrow structures

2022-10-28 Thread Yaron Gvili
Yes, byte_size.h is what I was looking for, thanks. Yaron. From: David Li Sent: Friday, October 28, 2022 9:52 AM To: dev@arrow.apache.org Subject: Re: measuring memory usage of Arrow structures This would also be a good cookbook example, so I filed [1]. (Sorry

Re: measuring memory usage of Arrow structures

2022-10-28 Thread David Li
This would also be a good cookbook example, so I filed [1]. (Sorry for the double-email.) [1]: https://github.com/apache/arrow-cookbook/issues/273 On Fri, Oct 28, 2022, at 09:51, David Li wrote: > I think Yaron is looking more for the APIs in arrow/util/byte_size.h > [1] which has utilities for

Re: measuring memory usage of Arrow structures

2022-10-28 Thread David Li
I think Yaron is looking more for the APIs in arrow/util/byte_size.h [1] which has utilities for estimating the size of the buffers in an array or record batch. (I'm assuming you're not concerned with the size of the C++ structures themselves.) [1]: https://github.com/apache/arrow/blob/master/c

Re: measuring memory usage of Arrow structures

2022-10-28 Thread Rok Mihevc
Hey Yaron, If you're using jemalloc you can use jemalloc_get_stat [1] to monitor total memory allocation. Another option would be LoggingMemoryPool, see tests on possible usage [2]. Rok [1] https://github.com/apache/arrow/blob/master/cpp/src/arrow/memory_pool_jemalloc.cc#L157 [2] https://github.

measuring memory usage of Arrow structures

2022-10-28 Thread Yaron Gvili
Hi, Is there a supported/convenient way for measuring the memory usage of Arrow structures? For my specific use case, measuring memory usage of either a record batch or an array would be sufficiently convenient. Cheers, Yaron.

Re: [ANNOUNCE] New Arrow PMC member: Jacob Quinn

2022-10-28 Thread Patrick Horan
Congrats Jacob! On Tue, Oct 25, 2022, at 5:06 PM, Sutou Kouhei wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Jacob Quinn to become a PMC member and we are pleased to announce > that Jacob Quinn has accepted. > > Congratulations and welcome! >

Re: [ANNOUNCE] New Arrow committer: Will Jones

2022-10-28 Thread Raúl Cumplido
Congratulations Will! El vie, 28 oct 2022 a las 11:46, Antoine Pitrou () escribió: > > Welcome Will, and thanks for your contributions! > > > Le 28/10/2022 à 01:56, Sutou Kouhei a écrit : > > On behalf of the Arrow PMC, I'm happy to announce that Will Jones > > has accepted an invitation to becom

Re: [ANNOUNCE] New Arrow committer: Will Jones

2022-10-28 Thread Antoine Pitrou
Welcome Will, and thanks for your contributions! Le 28/10/2022 à 01:56, Sutou Kouhei a écrit : On behalf of the Arrow PMC, I'm happy to announce that Will Jones has accepted an invitation to become a committer on Apache Arrow. Welcome, and thank you for your contributions! kou

Re: [ANNOUNCE] New Arrow committer: Will Jones

2022-10-28 Thread Rok Mihevc
Congratulations and welcome Will! :) Rok On Fri, Oct 28, 2022, 06:26 Anja wrote: > =) > > On Thu, 27 Oct 2022 at 16:56, Sutou Kouhei wrote: > > > On behalf of the Arrow PMC, I'm happy to announce that Will Jones > > has accepted an invitation to become a committer on Apache > > Arrow. Welc