More updates: 1. This behavior was found not only on M60, but also on TITAN 1080Ti or Xp.
2. When not setting up the p2p compatibility, i.e. run the original qemu with GPUs attached to the root pcie bus, the LnkSta on host always remains at 8 GT/s. Don't know why the new p2p change would cause the GPU driver in guest to re-negotiate its speed. I think it has gone beyond the community's responsibility to debug this tricky issue. So I have contacted nvidia for technical support, and they are expected to send me a reply in next few weeks. Will keep you guys updated. Bob 2017-08-31 0:43 GMT+08:00 Alex Williamson <alex.william...@redhat.com>: > On Wed, 30 Aug 2017 17:41:20 +0800 > Bob Chen <a175818...@gmail.com> wrote: > > > I think I have observed what you said... > > > > The link speed on host remained 8GT/s until I finished running > > p2pBandwidthLatencyTest > > for the first time. Then it became 2.5GT/s... > > > > > > # lspci -s 09:00.0 -vvv > ... > > LnkSta: Speed 8GT/s, Width x16, TrErr- Train- SlotClk+ DLActive- BWMgmt- > > So long as the device renegotiates to 8GT/s under load rather than > getting stuck at 2.5GT/s, I think this is the expected behavior. This > is a power saving measure by the driver. Thanks, > > Alex >