Re: [Hosting] UNPLANNED: Ganeti hypervisor node reboot

2022-08-05 Thread Lance Albertson
We just had the same thing happen to another node (gprod1). All of the VMs are back online now. List of affected VMs are the following: - apereo1.osuosl.org - app2.osuosl.org - area51-1.phpbb.com - buildroot-sources.osuosl.org - deluge.osuosl.org - jenkins-radish.osuosl.org

[Hosting] UNPLANNED: Ganeti hypervisor node reboot

2022-07-30 Thread Lance Albertson
All, One of our production Ganeti nodes (gprod3) decided to reboot on its own for some reason. All of the VMs should be back online but you might double check that your services are running properly. There was a thundering herd problem after the node booted where most of the VMs decided to do a fi