Re: Inquiry About Fedora Models

2025-06-12 Thread Lee Thomas Stephen
On Tue, Jun 10, 2025 at 7:02 PM JT wrote: > > You can run vllm, instructlab, etc on Fedora. It just won't be bundled > together and won't be tightly coupled with Red Hat's other offerings in the > way that it would be on RHEL AI. > There is a Fedora AI SIG: https://fedoraproject.org/wiki/SIGs/

Re: Inquiry About Fedora Models

2025-06-10 Thread JT
You can run vllm, instructlab, etc on Fedora. It just won't be bundled together and won't be tightly coupled with Red Hat's other offerings in the way that it would be on RHEL AI. There is a Fedora AI SIG: https://fedoraproject.org/wiki/SIGs/AI-ML As well as a Matrix channel: #ai-ml:fedoraproject

Re: Inquiry About Fedora Models

2025-06-10 Thread Josh Boyer
On Tue, Jun 10, 2025 at 5:32 AM Lee Thomas Stephen wrote: > > Hi everyone, > > Will there be a version similar to this one: > https://huggingface.co/RedHatAI for Fedora? I am not aware of any Fedora community projects around creating, tuning, distilling, or otherwise optimizing models, so it's un