Part two of this (labstore1007) will be starting in 20 min.   Impact should be 
brief for dumps nfs only.

Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bst...@wikimedia.org <mailto:bst...@wikimedia.org>
IRC: bstorm_

> On Dec 3, 2018, at 10:36 AM, Brooke Storm <bst...@wikimedia.org> wrote:
> 
> The first step of this is done and things look good.  The next reboot of 
> labstore1007 will be 2018-12-07 @ 1700 UTC.
> Please report related issues for the labstore1006, dumps NFS, reboot.
> 
> Brooke Storm
> Operations Engineer
> Wikimedia Cloud Services
> bst...@wikimedia.org <mailto:bst...@wikimedia.org>
> IRC: bstorm_
> 
>> On Dec 3, 2018, at 9:59 AM, Brooke Storm <bst...@wikimedia.org 
>> <mailto:bst...@wikimedia.org>> wrote:
>> 
>> We are beginning the first step of this shortly.  Again, it may cause some 
>> NFS actions to fail briefly and some load rise on clients, but the condition 
>> should be brief and temporary. 
>> 
>> Brooke Storm
>> Operations Engineer
>> Wikimedia Cloud Services
>> bst...@wikimedia.org <mailto:bst...@wikimedia.org>
>> IRC: bstorm_
>> 
>>> On Nov 28, 2018, at 3:42 PM, Brooke Storm <bst...@wikimedia.org 
>>> <mailto:bst...@wikimedia.org>> wrote:
>>> 
>>> On Monday, December 3rd, 2018 at 1700 UTC, we will be rebooting one of the 
>>> two dumps NFS servers (labstore1006.wikimedia.org 
>>> <http://labstore1006.wikimedia.org/>).  This should cause rising load 
>>> issues briefly, but should be quick enough that failing over services is 
>>> likely to not be helpful.  We will be failing over the web service before 
>>> that time and failing it back before rebooting the partner server 
>>> (labstore1007.wikimedia.org <http://labstore1007.wikimedia.org/>) on 
>>> Friday, December 7th at 1700 UTC.  This should not interrupt services to 
>>> dumps.wikimedia.org <http://dumps.wikimedia.org/> (the site hosted on these 
>>> systems) since that should be failed over to the non-rebooting partner.
>>> 
>>> Brooke Storm
>>> Operations Engineer
>>> Wikimedia Cloud Services
>>> bst...@wikimedia.org <mailto:bst...@wikimedia.org>
>>> IRC: bstorm_
>>> 
>> 
> 

_______________________________________________
Wikimedia Cloud Services announce mailing list
cloud-annou...@lists.wikimedia.org (formerly labs-annou...@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

Reply via email to