I have found the problem: /etc/mysql/ was only accessible by root. On Bullseye that wasn't a problem because I had SysV Init and apparently mariadb was started as root initially. The upgrade to Bookworm enforced systemd and now mariadb is started as mysql directly.
Unfortunately, mariadb didn't complain about missing permissions in any way.
