On 2024-03-06 22:06:18, Petter Reinholdtsen wrote: > [Antoine Beaupre] >> A CLI utility and Python library for interacting with Large Language >> Models, both via remote APIs and models that can be installed and run >> on your own machine. > > Is the option to run models locally related to llama.cpp, ref > <URL: https://bugs.debian.org/1063673 >?
I am not absolutely sure, but yes, I would assume that's one of the backends llm can use.