I'm running into this too, poked around a little bit, and found an issue filed on BlueZ's github repo that seems like it might be related: https://github.com/bluez/bluez/issues/686
Unclear what the proper fix is; there's some complaint on there that what they merged requires a new, unreleased kernel. But there's also a patch posted in a comment that some people claim fixes it (I have not yet tested): https://github.com/bluez/bluez/issues/686#issuecomment-1858902231
