Hello,

As mentioned, we ran into issues with the cookbook due to a typo, which has
been fixed <https://gerrit.wikimedia.org/r/c/operations/cookbooks/+/1193860>
.
We plan to try again on Thursday, 12:00 UTC.

The item has been added to the deployment calendar:
https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20251009T1200

Thank you for your patience.



On Mon, Oct 6, 2025 at 2:47 PM Lukasz Sobanski <[email protected]>
wrote:

> We ran into issues with the cookbook / cumin before Gerrit instances were
> switched over. All the changes have now been reverted and we'll try again
> after investigating.
>
> On Mon, Oct 6, 2025 at 1:53 PM Arnaud Bran <[email protected]> wrote:
>
>> Hello,
>>
>> small reminder: we'll start in a few minutes
>>
>> Thank you for your understanding
>>
>> On Mon, Sep 29, 2025 at 3:48 PM Arnaud Bran <[email protected]> wrote:
>>
>>> Hello,
>>>
>>> We will perform maintenance on Gerrit on *Monday, October 6*, from *12:00
>>> to 13:00 UTC*.
>>> During this window, we expect a *~20 minutes* write outage while we
>>> switch over Gerrit's service from the current primary (gerrit1003) to the
>>> spare host (gerrit2003).
>>> Since last time, we've added a few guardrails:
>>>
>>>    -
>>>
>>>    Local emergency backup on each instance.
>>>    -
>>>
>>>    All instances will be *read-only during the switchover *to protect
>>>    data integrity.
>>>    -
>>>
>>>    Pre- and post-switch checks to verify everything is in the expected
>>>    state.
>>>
>>> As before, we’ll perform the switchover *live with Release Engineering*.
>>>
>>> This operation will allow us to unblock a few things:
>>>
>>>    -
>>>
>>>    System daemon user: *gerrit2 → gerrit (*T338470
>>>    <https://phabricator.wikimedia.org/T338470>)
>>>    -
>>>
>>>    *OS upgrade* (T392464 <https://phabricator.wikimedia.org/T392464>,
>>>    T384595 <https://phabricator.wikimedia.org/T384595>)*, Java* (T392465
>>>    <https://phabricator.wikimedia.org/T392465>) version update and *Gerrit
>>>    *(T379714 <https://phabricator.wikimedia.org/T379714>, T392448
>>>    <https://phabricator.wikimedia.org/T392448>) version update
>>>
>>> *Expected impact*
>>>
>>>    -
>>>
>>>    A ~20 minutes *read-only* window; reads (browsing, cloning,
>>>    reviewing) should remain fine.  Pushes, votes, comments, etc. will be
>>>    blocked during that period
>>>    -
>>>
>>>    We’ll post start/end updates during the window.
>>>
>>> *Links*
>>>
>>>    -
>>>
>>>    Documentation:
>>>    https://wikitech.wikimedia.org/wiki/Gerrit/Operations#Switch_over
>>>    -
>>>
>>>    Phabricator: https://phabricator.wikimedia.org/T387833
>>>    -
>>>
>>>    Deployment Calendar:
>>>    
>>> https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20251006T1200
>>>
>>>
>>> Thank you for your understanding.
>>>
>>> --
>>> *Arnaud Bran* (he/him)
>>> Senior Site Reliability Engineer
>>> Wikimedia Foundation <https://wikimediafoundation.org/>
>>>
>> _______________________________________________
>> Wikitech-l mailing list -- [email protected]
>> To unsubscribe send an email to [email protected]
>>
>> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
>
>
>
> --
> Lukasz
> _______________________________________________
> Wikitech-l mailing list -- [email protected]
> To unsubscribe send an email to [email protected]
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
_______________________________________________
Wikitech-l mailing list -- [email protected]
To unsubscribe send an email to [email protected]
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

Reply via email to