Hi Cory, On 2025-01-27 09:44, Cordell Bloor wrote: > Could we just sidestep this whole question of native instructions by > building llama.cpp with the BLAS backend?
I was going to ship BLAS as one of the backends, but you do raise an interesting point: why ship the "regular" backend at all if we have BLAS guaranteed on Debian. And not just one, but many implementations of BLAS that can easily be switched, thanks to Mo's work with the alternatives subsystem. I could still ship a basic backend (for whatever reason) but instead of making it the default, make it user-selectable as a -noblas package. Though I don't see why we would need it. In any case, I've been working on this and will push draft to experimental sometime this week. It'll be rough (basically just one binary package) because to structure this properly, I need real-world feedback first. Best, Christian
