Same problem for me, i use Debian Testing wìth official cuda 565.57 Nvidia drivers and 6.12.6 kernel. I posted my experience in the Nvidia forum here (https://forums.developer.nvidia.com/t/565-release-feedback-discussion/310777/319) hoping in a Christmas present 😉 from Nvidia devs. Now i am using the 6.11.10 kernel but i didn't test the 565.77 drivers for a fix.
Regards