I've used Xfce for several months with single display and never got this issue, and when I recently changed back to dual display setup it didn't take long for this issue to reappear.
So this is still an issue, and is definitely related to using two displays. -- Markus Laire https://www.MarkusLaire.com