On Fri, Mar 31, 2023 at 10:52:09AM -0400, Peter Xu wrote: > On Fri, Mar 31, 2023 at 11:37:50AM -0300, Fabiano Rosas wrote: > > >> Outgoing migration to file. NVMe disk. XFS filesystem. > > >> > > >> - Single migration runs of stopped 32G guest with ~90% RAM usage. Guest > > >> running `stress-ng --vm 4 --vm-bytes 90% --vm-method all --verify -t > > >> 10m -v`: > > >> > > >> migration type | MB/s | pages/s | ms > > >> ----------------+------+---------+------ > > >> savevm io_uring | 434 | 102294 | 71473 > > > > > > So I assume this is the non-live migration scenario. Could you explain > > > what does io_uring mean here? > > > > > > > This table is all non-live migration. This particular line is a snapshot > > (hmp_savevm->save_snapshot). I thought it could be relevant because it > > is another way by which we write RAM into disk. > > I see, so if all non-live that explains, because I was curious what's the > relationship between this feature and the live snapshot that QEMU also > supports. > > I also don't immediately see why savevm will be much slower, do you have an > answer? Maybe it's somewhere but I just overlooked.. > > IIUC this is "vm suspend" case, so there's an extra benefit knowledge of > "we can stop the VM". It smells slightly weird to build this on top of > "migrate" from that pov, rather than "savevm", though. Any thoughts on > this aspect (on why not building this on top of "savevm")?
Currently savevm covers memory, device state and disk snapshots saving into the VM's disks, which basically means only works with qcow2. Libvirt's save logic only cares about saving memory and device state, and supports saving guests regardless of what storage is used, saving it externally from the disk. This is only possible with 'migrate' today and so 'savevm' isn't useful for this tasks from libvirt's POV. In the past it has been suggested that actually 'savevm' command as a concept is redundant, and that we could in fact layer it on top of a combination of migration and block snapshot APIs. eg if we had a 'blockdev:' migration protocol for saving the vmstate. With regards, Daniel -- |: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|