------- Comment From xxd...@de.ibm.com 2018-09-07 08:38 EDT-------
I have some more bad surprises:
On Monday I upgraded my x86 KVM hypervisors from 16.04.5 to 18.04.1.
No problems at all.

On Wednesday I upgraded the ppc KVM hypervisors from 16.04.5 to 18.04.1.

Problem 1:
In the middle of the upgrade process I could not live migrate the guests from 
the 16.04 hypervisor to the 18.04 hypervisor.
None of the 13 guests!

root@pkvm2:~# virsh migrate --persistent --live pkut04 qemu+ssh://pkvm1/system
error: internal error: process exited while connecting to monitor: 
2018-09-05T11:07:58.260851Z qemu-system-ppc64: warning: CPU(s) not present in 
any NUMA nodes: CPU 1 [core-id: 1]
2018-09-05T11:07:58.260859Z qemu-system-ppc64: warning: All CPU(s) up to 
maxcpus should be described in NUMA config, ability to start up with partial 
NUMA mappings is obsoleted and will be removed in future
2018-09-05T11:07:58.262038Z qemu-system-ppc64: This machine version does not 
support CPU hotplug

So I had to shutdown all the guests to do the upgrade of the second
hypervisor !!!

Probem 2:
When the second hypervisor was on 18.04.1 I could not start most of the guests.
Only 4 of 13 guests started.
(a) some qcow2 disks have been marked as sharable
worked on Ubuntu 16.04, but noot on 18.04
(b) vcpu definition
on Ubuntu 16.04 <vcpu placement='static' current='8'>160</vcpu> worked
on Ubuntu 18.04 this does not work on ppc ("This machine version does not 
support CPU hotplug").
I had to cahnge it to <vcpu placement='static'>8</vcpu>

I could resolve 2a and 2b. But it is frustrating to get such additional 
adventure games in the maintenance window.
You think "just start the guests, then I can go home", and then the guests do 
not start.
And it is even more frustrating when you did just the same task 2 days ago on 
x86 without any problems.

Maybe Problem 1 has the same reason as Problem 2. In other words: With the 
changed domain XML, maybe a live migration from Ubuntu 16.04 hypervisor to 
18.04 hypervisor would work.
But I cannot verify this assumption. Now both my hypervisors are finally on 
18.04.1 and live migration between them works for all guests.

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1783140

Title:
  KVM live migration fails

Status in The Ubuntu-power-systems project:
  In Progress
Status in linux package in Ubuntu:
  Triaged
Status in qemu package in Ubuntu:
  Incomplete

Bug description:
  Environment:
  2 POWER8 with Ubuntu 16.04.4 LTS as KVM hypervisor.
  1 KVM guest with Ubuntu 18.04 LTS. Virtual disk for the guest is a qcow2 file 
on an NFS share, accessible from both hypervisors, so live migration is 
possible and works for all other guests (SLES, RHEL, Ubunutu 16.04),
  Live migratino of Ubuntu 18.04 guest fails on ppc, while the same test on an 
x86_64 environment suceeds.

  root@pkvm2:~# virsh migrate --persistent --live p8lnxtst4 
qemu+ssh://pkvm1/system
  error: internal error: early end of file from monitor, possible problem: 
2018-07-23T11:12:25.586385Z qemu-system-ppc64: VQ 0 size 0x100 Guest index 
0x38aa inconsistent with Host index 0xa980: delta 0x8f2a
  2018-07-23T11:12:25.586434Z qemu-system-ppc64: error while loading state for 
instance 0x0 of device 'pci@800000020000000:01.0/virtio-net'
  2018-07-23T11:12:25.587246Z qemu-system-ppc64: load of migration failed: 
Operation not permitted

  root@pkvm2:~# uname -a
  Linux pkvm2 4.4.0-130-generic #156-Ubuntu SMP Thu Jun 14 08:51:21 UTC 2018 
ppc64le ppc64le ppc64le GNU/Linux

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu-power-systems/+bug/1783140/+subscriptions

-- 
Mailing list: https://launchpad.net/~kernel-packages
Post to     : kernel-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kernel-packages
More help   : https://help.launchpad.net/ListHelp

Reply via email to