Re: [Cloud] excessive lagging

2019-06-10 Thread Bryan Davis
On Mon, Jun 10, 2019 at 4:20 PM Yetkin Sakal via Cloud wrote: > > Hello, > > What can be done to decrease the lagging on web.db.svc.eqiad.wmflabs? Tools > working on this are severely affected ands up with outdated results. We did a bit of live investigation with the help of the DBA team on a re

Re: [Cloud] excessive lagging

2019-06-10 Thread Manuel Arostegui
We also have one host down for maintenance https://phabricator.wikimedia.org/T222978 which puts more load on the other two. El lun., 10 jun. 2019 16:35, Yetkin Sakal escribió: > All shards are affected. Please view the heartbeat report at > https://tools.wmflabs.org/replag/ > > Thanks. > On Mond

Re: [Cloud] excessive lagging

2019-06-10 Thread Yetkin Sakal via Cloud
All shards are affected. Please view the heartbeat report at https://tools.wmflabs.org/replag/ Thanks. On Monday, June 10, 2019, 6:27:44 PM GMT+3, Manuel Arostegui wrote: Hello, We currently have some issues going on.One of the hosts had issues with s4 (commonswiki) https://phabricator.

Re: [Cloud] excessive lagging

2019-06-10 Thread Manuel Arostegui
Hello, We currently have some issues going on. One of the hosts had issues with s4 (commonswiki) https://phabricator.wikimedia.org/T225390 And then S3 replica's master (which holds like 900 wikis) had hardware issues we are still trying to figure out https://phabricator.wikimedia.org/T225391 so t

Re: [Cloud] excessive lagging

2019-06-10 Thread John
Can you provide more information? Most of the time lag is minimal. enwiki is at 7 seconds, dewiki is at 0. On Mon, Jun 10, 2019 at 11:20 AM Yetkin Sakal via Cloud < cloud@lists.wikimedia.org> wrote: > Hello, > > What can be done to decrease the lagging on web.db.svc.eqiad.wmflabs? > Tools working

[Cloud] excessive lagging

2019-06-10 Thread Yetkin Sakal via Cloud
Hello, What can be done to decrease the lagging on web.db.svc.eqiad.wmflabs? Tools working on this are severely affected ands up with outdated results. Regards. ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wi