Re: [Cloud] [Cloud-announce] 2020-11-10 ToolsDB (User databases in Toolforge) read-only downtime

2020-11-11 Thread Brooke Storm
I have set ToolsDB to read-write again. It should be operating as normal now. I am continuing to work on the rebuild of the replica and am hoping that the replica will be able to catch up once the data import finishes. Thank you for your patience while we try to get this replicating again. Broo

Re: [Cloud] [Cloud-announce] Wiki Replicas 2020 Redesign

2020-11-11 Thread John
I’ll throw my hat in this too. Moving it to the application layer will make a number of queries just not feasible any longer. It might make sense from the administration side, but from the user perspective it beaks one of the biggest features that toolforge has. On Wed, Nov 11, 2020 at 6:40 PM Mar

Re: [Cloud] [Cloud-announce] Wiki Replicas 2020 Redesign

2020-11-11 Thread Martin Urbanec
MusikAnimal is right, however, Wikidata and Commons either have a sui generis slice, or they share it with a few very large wikis. Tools that do any kind of crosswiki analysis would instantly break, as most of them utilise joining by Wikidata items at the very least. I second Maarten here. This wo

Re: [Cloud] [Cloud-announce] 2020-11-10 ToolsDB (User databases in Toolforge) read-only downtime

2020-11-11 Thread Brooke Storm
Update: I don’t think it is going to be done in 10 minutes. I’m surprised, but the process is still running. I still believe it will complete today. > On Nov 11, 2020, at 8:31 AM, Brooke Storm wrote: > > Update: > ToolsDB remains in read-only mode while the data loads on the replica in > order

Re: [Cloud] [Cloud-announce] Wiki Replicas 2020 Redesign

2020-11-11 Thread Huji Lee
One some level, the real issue here is that different wikis are living on different slices (s1, s2, s3). One possible solution is to replicate "shared" wikis (Wikidata and Commons) and possibly a few other "mother" wikis (at least En WP) into *every* slice. The uses cases that need to join enwikti

Re: [Cloud] [Cloud-announce] Wiki Replicas 2020 Redesign

2020-11-11 Thread MusikAnimal
Technically, cross-wiki joins aren't completely disallowed, you just have to make sure each of the db names are on the same slice/section, right? ~ MA On Wed, Nov 11, 2020 at 4:11 PM Maarten Dammers wrote: > Hi Joaquin, > On 10-11-2020 21:26, Joaquin Oltra Hernandez wrote: > > TLDR: Wiki Replic

Re: [Cloud] [Cloud-announce] Wiki Replicas 2020 Redesign

2020-11-11 Thread Maarten Dammers
Hi Joaquin, On 10-11-2020 21:26, Joaquin Oltra Hernandez wrote: TLDR: Wiki Replicas' architecture is being redesigned for stability and performance. Cross database JOINs will not be available and a host connection will only allow querying its associated DB. See [1]

Re: [Cloud] [Cloud-announce] 2020-11-10 ToolsDB (User databases in Toolforge) read-only downtime

2020-11-11 Thread Brooke Storm
Update: ToolsDB remains in read-only mode while the data loads on the replica in order to minimize the possibility that this won’t work. All steps have been successful so far, but the size and heterogeneity of this database service has made every step take large amounts of time for the system t

Re: [Cloud] [Cloud-announce] 2020-11-10 ToolsDB (User databases in Toolforge) read-only downtime

2020-11-11 Thread Arthur Smith
Any update on this? I still get a "The MariaDB server is running with the --read-only option so it cannot execute this statement" message when I try to do anything! Arthur On Tue, Nov 10, 2020 at 10:52 AM Brooke Storm wrote: > This will be happening in around 10 minutes. ToolsDB will be read-