Re: Guidance on Very Conservative Default X86 ISA

2023-01-08 Thread Andrew Lamb
I left some comments on the ticket, mostly about UX and warning rather than erroring; Given this is likely to affect users of the arrow crate more than the developers I think it would be a good idea to socialize the proposal some more, perhaps on the us...@arrow.apache.org and the slack channel if

Re: Guidance on Very Conservative Default X86 ISA

2023-01-07 Thread vertexclique vertexclique
Hi, I have added AVX512 kernels back in times but they got removed with a reason that I don't agree. (No objections, that was the maintainers decision.) I am totally in line with you and prefer having feature gated SIMD supersets for the compilation and have compile time selection. I was working

Re: Guidance on Very Conservative Default X86 ISA

2023-01-07 Thread Antoine Pitrou
Hi, For reference, the C++ implementation is compiled by default with SSE4.2 enabled. We had some rare bug reports of people using very old CPUs where Arrow C++ would crash (for example for lack of POPCNT instruction, which is very useful for fast null count computation). We also have some

Guidance on Very Conservative Default X86 ISA

2023-01-07 Thread Raphael Taylor-Davies
Hi, It is fairy common to see binaries in the wild making use of the Rust arrow libraries compiled with extremely limited SIMD support enabled. As I imagine others in the community have run into this before, I thought I'd send an email to solicit thoughts. There are a couple of things that m