RE: Usage of JDK Vector API in ML/MLLib

2020-12-16 Thread Ludovic Henry
I’ve submitted https://github.com/apache/spark/pull/30810. It does use a profile to selectively compile VectorizedBLAS, and it uses reflection to try loading it at run-time and falls back to F2jBLAS. I’m running right now the benchmarks on my x86 machine and I’ll post them on the PR. From: Sea

Re: Usage of JDK Vector API in ML/MLLib

2020-12-16 Thread Sean Owen
It's fine to prototype it. Because users can also get BLAS support by enabling a profile already, I think it bears understanding if perf is at least comparable before adding it as another option. Or it could simply be an extra module / library until that time if it's desirable to release. This may

RE: Usage of JDK Vector API in ML/MLLib

2020-12-16 Thread Ludovic Henry
Hi, Thank you for the feedback. I’ll work on the profile-based approach to selectively compile this VectorBLAS class in. As for the run-time, I haven’t used specifically a reflection-based approach but a more simple `try { new VectorBLAS() } catch (NoClassDefFoundError) { new F2jBLAS() }`. I’ll