Thanks. I learned something new. Yes, as you discovered I would only expect VLC hardware decoding to work in a "Ubuntu on Xorg" session with the VLC option "VA-API video decoder via X11". Because that's the only combination of session and VLC option that's even theoretically compatible at all. Although performance in this mode is still relatively poor compared to MPV or even Totem. So I'd recommend those first.
Using "VA-API video decoder via DRM" I would not expect to work under Wayland. And it doesn't. It sounds like someone needs to log an enhancement/bug with VLC upstream to add a new option "VA-API video decoder via Wayland". Because that's the missing option (where the possible options are https://github.com/01org/libva/blob/master/va/va_backend.h#L39 ). ** No longer affects: vlc (Ubuntu) -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to mutter in Ubuntu. https://bugs.launchpad.net/bugs/1698287 Title: VA-API fails to initialize in a Gnome Shell Wayland session To manage notifications about this bug go to: https://bugs.launchpad.net/libva/+bug/1698287/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs