Public bug reported:
Steps to reproduce:
- make sure Eucalyptus NC is up and running
- run /etc/init.d/libvirt-bin restart
- try to start a new Instance. If all other NC's are busy and the new request
lands in the current NC, then
/var/log/eucalyptus/nc.log
will show:
[EUCAINFO ] doRunInstance() invoked (id=i-4912092F cores=2 disk=10 memory=512)
...
[EUCAERROR ] libvirt: cannot send data: Broken pipe (code=38)
...
[EUCAINFO ] currently running/booting: i-4912092F
[EUCAERROR ] libvirt: cannot send data: Broken pipe (code=38)
[EUCAFATAL ] hypervisor failed to start domain
...
[EUCAINFO ] doTerminateInstance() invoked (id=i-4912092F)
[EUCAERROR ] libvirt: cannot send data: Broken pipe (code=38)
[EUCAWARN ] warning: domain i-4912092F to be terminated not running on
hypervisor
Apparently the NC keeps trying to use the old libvirtd socket and doesn't
notice the daemon was restarted.
Another VERY nasty consequence is that Eucalyptus looses track of the
previously running instances in that node! (even if they stay running in KVM)
In CC.log:
[EUCAINFO ] TerminateInstances(): calling terminate instance (i-42A10746) on
(141.x.x.x)
[EUCAERROR ] ERROR: TerminateInstance() could not be invoked (check NC host,
port, and credentials)
while in the NC we still have:
# virsh list
Connecting to uri: qemu:///system
Id Name State
----------------------------------
107 i-42A10746 running
At the very least the libvirt-bin/Euca-NC upstart dependencies should be such
that restarting libvirtd restarts NC, or ideally and much better, Eucalyptus NC
should be fixed to handle a restarted libvirtd.
Description: Ubuntu 9.10
Release: 9.10
ii euca2ools 1.0+bzr20091007-0ubuntu1.1
managing cloud instances for Eucalyptus
ii eucalyptus-common 1.6~bzr931-0ubuntu7.4
Elastic Utility Computing Architecture - Com
ii eucalyptus-gl 1.6~bzr931-0ubuntu7.4
Elastic Utility Computing Architecture - Log
ii eucalyptus-nc 1.6~bzr931-0ubuntu7.4
Elastic Utility Computing Architecture
** Affects: eucalyptus (Ubuntu)
Importance: Undecided
Status: New
--
Restarting libvirtd breaks Eucalyptus NC
https://bugs.launchpad.net/bugs/512887
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to eucalyptus in ubuntu.
--
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at:
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
