------- Comment From xxd...@de.ibm.com 2018-09-07 08:38 EDT------- I have some more bad surprises: On Monday I upgraded my x86 KVM hypervisors from 16.04.5 to 18.04.1. No problems at all.
On Wednesday I upgraded the ppc KVM hypervisors from 16.04.5 to 18.04.1. Problem 1: In the middle of the upgrade process I could not live migrate the guests from the 16.04 hypervisor to the 18.04 hypervisor. None of the 13 guests! root@pkvm2:~# virsh migrate --persistent --live pkut04 qemu+ssh://pkvm1/system error: internal error: process exited while connecting to monitor: 2018-09-05T11:07:58.260851Z qemu-system-ppc64: warning: CPU(s) not present in any NUMA nodes: CPU 1 [core-id: 1] 2018-09-05T11:07:58.260859Z qemu-system-ppc64: warning: All CPU(s) up to maxcpus should be described in NUMA config, ability to start up with partial NUMA mappings is obsoleted and will be removed in future 2018-09-05T11:07:58.262038Z qemu-system-ppc64: This machine version does not support CPU hotplug So I had to shutdown all the guests to do the upgrade of the second hypervisor !!! Probem 2: When the second hypervisor was on 18.04.1 I could not start most of the guests. Only 4 of 13 guests started. (a) some qcow2 disks have been marked as sharable worked on Ubuntu 16.04, but noot on 18.04 (b) vcpu definition on Ubuntu 16.04 <vcpu placement='static' current='8'>160</vcpu> worked on Ubuntu 18.04 this does not work on ppc ("This machine version does not support CPU hotplug"). I had to cahnge it to <vcpu placement='static'>8</vcpu> I could resolve 2a and 2b. But it is frustrating to get such additional adventure games in the maintenance window. You think "just start the guests, then I can go home", and then the guests do not start. And it is even more frustrating when you did just the same task 2 days ago on x86 without any problems. Maybe Problem 1 has the same reason as Problem 2. In other words: With the changed domain XML, maybe a live migration from Ubuntu 16.04 hypervisor to 18.04 hypervisor would work. But I cannot verify this assumption. Now both my hypervisors are finally on 18.04.1 and live migration between them works for all guests. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1783140 Title: KVM live migration fails Status in The Ubuntu-power-systems project: In Progress Status in linux package in Ubuntu: Triaged Status in qemu package in Ubuntu: Incomplete Bug description: Environment: 2 POWER8 with Ubuntu 16.04.4 LTS as KVM hypervisor. 1 KVM guest with Ubuntu 18.04 LTS. Virtual disk for the guest is a qcow2 file on an NFS share, accessible from both hypervisors, so live migration is possible and works for all other guests (SLES, RHEL, Ubunutu 16.04), Live migratino of Ubuntu 18.04 guest fails on ppc, while the same test on an x86_64 environment suceeds. root@pkvm2:~# virsh migrate --persistent --live p8lnxtst4 qemu+ssh://pkvm1/system error: internal error: early end of file from monitor, possible problem: 2018-07-23T11:12:25.586385Z qemu-system-ppc64: VQ 0 size 0x100 Guest index 0x38aa inconsistent with Host index 0xa980: delta 0x8f2a 2018-07-23T11:12:25.586434Z qemu-system-ppc64: error while loading state for instance 0x0 of device 'pci@800000020000000:01.0/virtio-net' 2018-07-23T11:12:25.587246Z qemu-system-ppc64: load of migration failed: Operation not permitted root@pkvm2:~# uname -a Linux pkvm2 4.4.0-130-generic #156-Ubuntu SMP Thu Jun 14 08:51:21 UTC 2018 ppc64le ppc64le ppc64le GNU/Linux To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1783140/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp