The first step of this is done and things look good.  The next reboot of 
labstore1007 will be 2018-12-07 @ 1700 UTC.
Please report related issues for the labstore1006, dumps NFS, reboot.

Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bst...@wikimedia.org <mailto:bst...@wikimedia.org>
IRC: bstorm_

> On Dec 3, 2018, at 9:59 AM, Brooke Storm <bst...@wikimedia.org> wrote:
> 
> We are beginning the first step of this shortly.  Again, it may cause some 
> NFS actions to fail briefly and some load rise on clients, but the condition 
> should be brief and temporary. 
> 
> Brooke Storm
> Operations Engineer
> Wikimedia Cloud Services
> bst...@wikimedia.org <mailto:bst...@wikimedia.org>
> IRC: bstorm_
> 
>> On Nov 28, 2018, at 3:42 PM, Brooke Storm <bst...@wikimedia.org 
>> <mailto:bst...@wikimedia.org>> wrote:
>> 
>> On Monday, December 3rd, 2018 at 1700 UTC, we will be rebooting one of the 
>> two dumps NFS servers (labstore1006.wikimedia.org 
>> <http://labstore1006.wikimedia.org/>).  This should cause rising load issues 
>> briefly, but should be quick enough that failing over services is likely to 
>> not be helpful.  We will be failing over the web service before that time 
>> and failing it back before rebooting the partner server 
>> (labstore1007.wikimedia.org <http://labstore1007.wikimedia.org/>) on Friday, 
>> December 7th at 1700 UTC.  This should not interrupt services to 
>> dumps.wikimedia.org <http://dumps.wikimedia.org/> (the site hosted on these 
>> systems) since that should be failed over to the non-rebooting partner.
>> 
>> Brooke Storm
>> Operations Engineer
>> Wikimedia Cloud Services
>> bst...@wikimedia.org <mailto:bst...@wikimedia.org>
>> IRC: bstorm_
>> 
> 

_______________________________________________
Wikimedia Cloud Services announce mailing list
cloud-annou...@lists.wikimedia.org (formerly labs-annou...@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

Reply via email to