Since it's now possible in Toolforge to expose services at custom ports[0], I think it should already be possible for someone to host an LLM service for other tools to use.
I could be wrong though, as LLMs might also require significant memory/CPU resources and/or system software not available to tools. [0]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Configuring_internal_domain_names_for_your_jobs On Fri, 10 Jan 2025 at 16:31, Francesco Negri <fne...@wikimedia.org> wrote: > > A phabricator ticket would also be useful, to help inform future > actions. Would > > you mind creating one? > > We have https://phabricator.wikimedia.org/T336905 that seems to cover > the same topic. > > -- > Francesco Negri (he/him) -- IRC: dhinus > Site Reliability Engineer, Cloud Services team > Wikimedia Foundation > _______________________________________________ > Cloud mailing list -- cloud@lists.wikimedia.org > List information: > https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/ >
_______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/
