Re: [DISCUSS] State of the Arrow Project 2022

2023-01-07 Thread Jacob Wujciak
+1 to the existing suggestions, this is such a great thread, great start to the year! A theme from this thread I would like to pick up is "community ux": The community overview on the arrow page is quite small and afaik the different syncalls and zulip are not documented anywhere, so we should impr

[VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 16.0.0 RC1

2023-01-07 Thread Andy Grove
Hi, I would like to propose a release of Apache Arrow DataFusion Implementation, version 16.0.0. This release candidate is based on commit: dcd52ee3d87c4dd9e2c176165e9e20644f66988b [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download

Re: [DISCUSS] State of the Arrow Project 2022

2023-01-07 Thread Andrew Lamb
We have used pull request templates in the various rust projects to good effect: most PRs clearly describe what they are doing and why. For your reference, they are at arrow-rs[1] and arrow-datafusion[2]. [1] https://raw.githubusercontent.com/apache/arrow-rs/master/.github/pull_request_template.m

Re: Guidance on Very Conservative Default X86 ISA

2023-01-07 Thread vertexclique vertexclique
Hi, I have added AVX512 kernels back in times but they got removed with a reason that I don't agree. (No objections, that was the maintainers decision.) I am totally in line with you and prefer having feature gated SIMD supersets for the compilation and have compile time selection. I was working

Re: [VOTE] Accept donation of datafusion-substrait crate

2023-01-07 Thread Kun Liu
+1 Thanks vin jake 于2023年1月7日周六 19:13写道: > +1 > > L. C. Hsieh 于 2023年1月7日周六 16:11写道: > > > +1 > > > > Thanks Andy. > > > > On Sat, Jan 7, 2023 at 12:04 AM Andrew Lamb > wrote: > > > > > > +1 -- thank you for driving this Andy > > > > > > On Thu, Jan 5, 2023 at 5:49 PM Andy Grove > wrote: > >

Re: Guidance on Very Conservative Default X86 ISA

2023-01-07 Thread Antoine Pitrou
Hi, For reference, the C++ implementation is compiled by default with SSE4.2 enabled. We had some rare bug reports of people using very old CPUs where Arrow C++ would crash (for example for lack of POPCNT instruction, which is very useful for fast null count computation). We also have some

Guidance on Very Conservative Default X86 ISA

2023-01-07 Thread Raphael Taylor-Davies
Hi, It is fairy common to see binaries in the wild making use of the Rust arrow libraries compiled with extremely limited SIMD support enabled. As I imagine others in the community have run into this before, I thought I'd send an email to solicit thoughts. There are a couple of things that m

Re: [VOTE] Accept donation of datafusion-substrait crate

2023-01-07 Thread vin jake
+1 L. C. Hsieh 于 2023年1月7日周六 16:11写道: > +1 > > Thanks Andy. > > On Sat, Jan 7, 2023 at 12:04 AM Andrew Lamb wrote: > > > > +1 -- thank you for driving this Andy > > > > On Thu, Jan 5, 2023 at 5:49 PM Andy Grove wrote: > > > > > The IP clearance form is now visible on the web site: > > > > http

Re: [Monorepo] Add labels breaking-change and critical-fix

2023-01-07 Thread Rok Mihevc
> > I replied in the GitHub thread [1], but will say that I am +1 on Priority: > Blocker and Priority: Critical. Though I wonder if we could use "Critical > Fix" in place of "Priority: Critical"? Unless we have two different > definitions. As is, the names are similar enough that it could be > conf

Re: [VOTE] Accept donation of datafusion-substrait crate

2023-01-07 Thread L. C. Hsieh
+1 Thanks Andy. On Sat, Jan 7, 2023 at 12:04 AM Andrew Lamb wrote: > > +1 -- thank you for driving this Andy > > On Thu, Jan 5, 2023 at 5:49 PM Andy Grove wrote: > > > The IP clearance form is now visible on the web site: > > https://incubator.apache.org/ip-clearance/arrow-datafusion-substrait.

Re: [VOTE] Accept donation of datafusion-substrait crate

2023-01-07 Thread Andrew Lamb
+1 -- thank you for driving this Andy On Thu, Jan 5, 2023 at 5:49 PM Andy Grove wrote: > The IP clearance form is now visible on the web site: > https://incubator.apache.org/ip-clearance/arrow-datafusion-substrait.html > > On Thu, Jan 5, 2023 at 9:33 AM Wayne Xia wrote: > > > +1 > > > > Daniël