In .xscreensaverrc, pointerHysteresis controls this. However, there is undocumented (too low) maximum. See also bug #34854.
-- mouse movement wakes screensaver https://launchpad.net/bugs/37139 -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs