[Cloud] Re: Expired certificate?

#x27;t do any harm. It's there because it still gets installed in the "base" class (profile::base::certificates) in puppet.https://wikitech.wikimedia.org/wiki/HTTPS/WMF_CAOn Tue, Dec 19, 2023 at 4:23 PM Roy Smith <r...@panix.com> wrote:Poking around on my debian bookworm

[Cloud] Re: javascript tooling?

rectory.Good luck!-TravisOn Thu, Aug 8, 2024 at 8:36 AM Kimmo Virtanen <kimmo.virta...@gmail.com> wrote:Hi,Vue.js is afaik current choice.- https://www.mediawiki.org/wiki/Vue.js-- KimmoOn Thu, Aug 8, 2024 at 6:34 PM Roy Smith <r...@panix.com> wrote:I'm about to embark on bu

Re: [Cloud] [Labs-l] Getting toolforge access?

Thanks. > On Sep 28, 2017, at 11:12 AM, Bryan Davis wrote: > > On Thu, Sep 28, 2017 at 5:36 AM, Roy Smith wrote: >> I applied for a toolforge account about a week ago and haven’t heard >> anything. I’m not sure if I used the wrong process, or if I should just be >

[Cloud] TFA and Apple Touch ID?

What’s the current best practice for auth on ToolForge? I have a passphrase on my public ssh key. I’ll be accessing toolforge from my MacBook which is protected with Apple’s Touch ID fingerprint scanner. I’ll be nailing up a tmux session. So, most of the time, there will be an active ssh sess

Re: [Cloud] TFA and Apple Touch ID?

> On Sep 30, 2017, at 3:49 PM, Michael Schönitzer > wrote: > > I agree and even worse: if your password gets stolen you can change it but > you cant change your fingerprint. Actually, that’s not true. The problem is, I can only change it 9 times :-) __

[Cloud] revision.rev_text_id is always 0?

I’ve been exploring the enwiki database. I can find the page row for [[Iron]] > MariaDB [enwiki_p]> select page_title from page where page_id = 14734; > ++ > | page_title | > ++ > | Iron | > ++ It looks like it has the right number of revisions: > Maria

Re: [Cloud] revision.rev_text_id is always 0?

via the DBs - you must go through the > API. > > On 1 October 2017 at 04:31, Roy Smith wrote: >> I’ve been exploring the enwiki database. I can find the page row for >> [[Iron]] >> >> MariaDB [enwiki_p]> select page_title from page where

Re: [Cloud] revision.rev_text_id is always 0?

only valid for the underlying > database, you do not have access to that as a labs user - you just > have security-sanitised views. rev_text_ids are not useful to you as > you cannot access revision texts via the DBs - you must go through the > API. > > On 1 October 2017 at 04:31, R

[Cloud] Tmux tab completion?

On login.tools.wmflabs.org , tab completion works for most things on the bash command line, but not tmux. Is there something special I need do to enable tmux tab completion? ___ Wikimedia Cloud Services mailing list Cl

[Cloud] Finding tags in wiki text?

I want to write a tool which checks that you are consistent about ordering of tags. For example, if I did: > The sky is blue. > The grass is green. This would get rendered as: > The sky is blue.[1][2] The grass is green.[2][1] When what you want is: > The sky is blue.[1][2] The grass is g

Re: [Cloud] Finding tags in wiki text?

. > On Feb 10, 2018, at 3:28 PM, Roy Smith wrote: > > I want to write a tool which checks that you are consistent about ordering of > tags. For example, if I did: > >> The sky is blue. >> The grass is green. > > This would get rendered as: > >> The

[Cloud] Category hidden flag with mwclient?

I want to use mwclient to explore categories. I can get the list of all categories for a page , but I don't see how to limit that to just non-hidden cats. At the API level

[Cloud] Reverting phabricator vandalism?

A rogue user vandalized a bunch of tasks in phabricator, including several that I opened. I see that account has now been disabled, but is there some easy way to revert the damage they did to my tasks? Or do I need to laboriously edit each task a

[Cloud] Unit testing with mwclient?

How do people write unit tests for python mwclient apps? Is there some sort of API mock/fake/stub/whatever that people run tests against? ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) https:/

[Cloud] Intermittent hangs on tools-sgebastion-07?

The last couple of days, I've been having problems with interactive ssh into login.tools.wmflabs.org . Every so often (multiple times an hour, at least), my connection will hang for a few seconds. Sometimes more like 10-15 seconds. I connect from my home MacOS

[Cloud] protobufs?

I'm starting to look at some machine learning projects I've wanted to do for a while (ex: sock-puppet detection). This quickly leads to having to make decisions about data storage formats, i.e. csv, json, protobufs, etc. Left to my own devices, I'd probably use protos, but I don't want to be s

Re: [Cloud] protobufs?

es Survey, a question that mentioned MongoDB. Is mongo used inside of WMF? It seems like it would be a natural in a JSON shop. I don't see it running on the bastion hosts. > On Nov 25, 2019, at 11:14 AM, Andrew Otto wrote: > > Hi Roy, > > We had to evaluate data for

Re: [Cloud] protobufs?

Thanks again for the additional info. I've been doing more reading about JSON Schema, and am growing fond of the idea. The idea of schema-driven fuzz testing with https://pypi.org/project/hypothesis-jsonschema/ is pretty cool.

[Cloud] /util/arch and /usrlbin//now missing?

When I run qstatus on tools-sgebastion-08, I get the following errors: (env) utils $ qstatus /usr/bin/qstatus: line 299: /util/arch: No such file or directory /usr/bin/qstatus: line 300: /utilbin//now: No such file or directory Waiting jobs for user: roysmith job-ID # name

[Cloud] Decoding log_params for blocks?

Is there a description somewhere of what the log_params mean in this query? MariaDB [enwiki_p]> select log_params from logging_logindex where log_namespace = 2 and log_title = 'RoySmith-testing' and log_type = 'block' order by log_timestamp asc; +-

Re: [Cloud] Decoding log_params for blocks?

https://www.php.net/manual/en/function.serialize.php > <https://www.php.net/manual/en/function.serialize.php> > [2] https://www.mediawiki.org/wiki/Manual:Logging_table#log_params > <https://www.mediawiki.org/wiki/Manual:Logging_table#log_params> > On Wed, Dec 4, 2019 at 9:50 PM Ro

Re: [Cloud] Decoding log_params for blocks?

> On Dec 4, 2019, at 8:07 PM, Roy Smith wrote: > > I also need to figure out how to parse this in Python. Oh, looks like https://pypi.org/project/phpserialize/ <https://pypi.org/project/phpserialize/> can handle that part.___ Wikimedia

Re: [Cloud] Decoding log_params for blocks?

> On Dec 4, 2019, at 9:51 PM, Dennis Tobar wrote: > > Roy: > > Sorry if I was bit rude in my previous email. Oh, not at all. I didn't think you were rude. You got me pointed in the right direction, which I appreciate, and I think I've got enough here (and from

[Cloud] Cassandra?

Is there a publicly-accessable Cassandra instance? https://wikitech.wikimedia.org/wiki/Cassandra#Getting_a_CQL_shell implies that there is, but cqlsh doesn't seem to exist on tools-sgebastion-08: > $ cqlsh > -bash: cqlsh: comm

[Cloud] toolforge and jupyter?

I want to use jupyter to do some data visualization. I found PAWS, but I can't access my toolforge directory: > FileNotFoundError: [Errno 2] No such file or directory: > '/home/roysmith/sock-classifier/jobs/last/job.out' Is there a way to access my toolforge directory from within PAWS? Altern

Re: [Cloud] toolforge and jupyter?

.paws user needs to be able to read and write to the files and > directories there. > > Cheers, > > Chico Venancio > > Em sáb, 7 de dez de 2019 14:27, Roy Smith <mailto:r...@panix.com>> escreveu: > I want to use jupyter to do some data visualization. I found PAWS, bu

Re: [Cloud] toolforge and jupyter?

I figured it out. I can make a directory that's world writable, and then push my data files to there. Seems like a strange way to do it, but I'm not seeing anything cleaner. > On Dec 7, 2019, at 2:12 PM, Roy Smith wrote: > > Hmmm. OK, I see my paws directory mounted on

[Cloud] varbinary fields in database?

Fields such as user.user_name, are varbinary. I'm writing this field as part of a json object in python; json.dumps() requires a string, not bytes, so I need to know the encoding. I assume these are all utf-8? ___ Wikimedia Cloud Services mailing list

Re: [Cloud] varbinary fields in database?

> On Dec 13, 2019, at 5:04 AM, Jaime Crespo wrote: > > Hi, Roy, > > I will answer assuming you are talking about wikireplicas/WMF production, or > the default Mediawiki installation Yes. Specifically, the instance you get when you run "sql enwiki" from tools-sg

[Cloud] Adding SSH key to wikitech?

I'm working my way through the instructions at https://www.mediawiki.org/wiki/Gerrit/Tutorial/tl;dr . I'm up to adding my SSH key to wikitech. I go to https://wikitech.wikimedia.org/wiki/Special:NovaKey

Re: [Cloud] Adding SSH key to wikitech?

> On Jan 11, 2020, at 6:34 AM, Alex Monk wrote: > > Wikitech writes it into LDAP where it'll get read when you SSH into things. > > Please paste your public key here so we can have a look. I've got two different keys I've tried. Both get the same result on wikitech, but work fine in Phab. Pa

Re: [Cloud] Adding SSH key to wikitech?

Kok11KTEo0gdDcIEWFyFJAGmsloCPhQiceU2xa0x6OigzxHSufzoNZyNpW+lxDEOxU8fJVMJ8NlVpEH13F5h4dztIAvwvOftE/UZRGfKI1TWzYrmY+YerZUZJF3o9VA0y3D9IE76OFg2BqQpcQh7KbSF0qemM7mFJWdSdMnEbo1AnrX7jxZ+mz0Cdh > RoySmith/wikimedia > > I get the same error if I try to add a duplicate key. > > On Sat, 11 Jan 202

Re: [Cloud] Adding SSH key to wikitech?

to LDAP. > > On Sat, 11 Jan 2020 at 15:30, Roy Smith <mailto:r...@panix.com>> wrote: > OK,thanks. It's possible I uploaded them long ago for a different project I > was working on, but I don't recall seeing this page before. Are there other > interfaces that m

[Cloud] Searching this list?

As far as I can tell, there's currently no way to search this list other than month-by-month via the pipermail archive page ? Not sure what the process is here, but I gather (from T193572 ) that each list h

Re: [Cloud] Searching this list?

https://phabricator.wikimedia.org/T242520 <https://phabricator.wikimedia.org/T242520> > On Jan 11, 2020, at 1:39 PM, RhinosF1 - wrote: > > I can't see there being an issue. Maybe create a phab task for it? > > RhinosF1 > > On Sat, 11 Jan 2020 at 17:59, R

[Cloud] What's my URL?

I've got a django-based tool that I was previously running in test mode directly on the bastion hosts using runserver. Now I'm trying to move that over the kubernetes for production. I've got things to the point where I can bring up a pod and see the server start by watching uwsgi.log: > SIGI

Re: [Cloud] What's my URL?

Never mind, I found it by trial-and-error. It's https://tools.wmflabs.org/spi-tools/ <https://tools.wmflabs.org/spi-tools/> But, is that documented anywhere in the wiki? > On Jan 12, 2020, at 12:35 AM, Roy Smith wrote: > > I've got a django-based tool that I was p

Re: [Cloud] What's my URL?

does say "The tool name is > used as part of the URL for the tool's webservice." > > On Sun, 12 Jan 2020, 05:47 Roy Smith, <mailto:r...@panix.com>> wrote: > Never mind, I found it by trial-and-error. It's > https://tools.wmflabs.org/spi-tools/ <ht

[Cloud] etcd has no leader?

I just got the following error. I reran the command and it worked the second time. My limited experience with etcd says this is not a good thing, so figured you'd want to know about it. > tools.spi-tools@tools-sgebastion-08:~/www/python/src$ webservice > --backend=kubernetes python3.7 rest

[Cloud] cache control on tools-static.wmflabs.org?

Is there a way to set the cache-control header for files served by tools-static.wmflabs.org ?___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) https://lists.wikimed

[Cloud] PSA about secrets

I was poking around in /data/project/ just now, looking for examples of how other tools set up their django apps. I was surprised (well, only a little) to discover that there's a few world-readable app.py files that have their django_secrets embedded in them. That's not a good idea folks. Sec

[Cloud] Workflow for kubernetes?

The bastion hosts don't have python3.7, and the k8s hosts don't have ssh, so "git pull" and "git push" don't work. Which means I need to keep flipping back and forth between the two during development. Is there some way to get ssh working on the k8s hosts, so I can do everything in one place?

Re: [Cloud] Workflow for kubernetes?

webservice --backend=kubernetes python3.7 shell > On Feb 21, 2020, at 12:35 PM, Brooke Storm wrote: > > Hello Roy, > The container environment for webservice shell is the same image as the > runtime containers for a service, so I'd rather not support ssh in the > containers b

Re: [Cloud] Workflow for kubernetes?

rom a container, so I'd not encountered that issue. > Overall, I'm getting that this is a clash with tmux keybindings, right? > > On a task, we can poke at the issue a bit, and maybe record a solution, > either local to your tool account or in general. > > On 2

[Cloud] Need help with selectize.js

I'm mostly a python guy, who only dabbles in javascript when I can't avoid it :-) I've got a django-based tool (https://tools.wmflabs.org/spi-tools-dev/spi/ ) which uses selectize.js. For simple cases, everything works fine. But, if I click on the

Re: [Cloud] Screen sessions

When you ssh into the bastion host, make sure you use the "-t" option to ssh. That forces a pseudo-terminal to get allocated. I have no clue why that's not the default. > On Jun 23, 2020, at 10:47 AM, Isaac Johnson wrote: > > I'm interested in running some long-ish scripts that loop through

Re: [Cloud] Need help with selectize.js

Thank you for reminding me that fixing this has been on my list for a while. My CSP-fu is weak. As I understand it, all I need do is: https://stackpath.bootstrapcdn.com/bootstrap/4.3.1/css/bootstrap.min.css"; - integrity="sha384-ggOyR0iXCbM

Re: [Cloud] Need help with selectize.js

#x27;m assuming) that will provide some protection against the file being unexpectedly replaced with something else? > On Jun 24, 2020, at 9:41 AM, Roy Smith wrote: > > Thank you for reminding me that fixing this has been on my list > <https://github.com/roysmith/spi-to

Re: [Cloud] Need help with selectize.js

think there's like some basic software engineering lesson in there :-) > On Jun 22, 2020, at 10:01 PM, Roy Smith wrote: > > I'm mostly a python guy, who only dabbles in javascript when I can't avoid it > :-) > > I've got a django-based tool (https://tools.wm

[Cloud] Slow uWSGI logging

I'm running a web server with "webservice --backend=kubernetes python3.7". As I tail the uwsgi.log file, requests to my server get logged with very long delays. I just timed one at about a minute and a half between when the request was served (03:07:57 UTC 2020) and when it showed up in the lo

Re: [Cloud] Slow uWSGI logging

rote: > > My guess is output stream buffering, at either the libc level or the > python level. > > Which tool is this? I can probably strace and see if that is the case. > > YiFei Zhu > > > On Wed, Jun 24, 2020 at 10:16 PM Roy Smith wrote: >> >> I

Re: [Cloud] Slow uWSGI logging

tool is this? I can probably strace and see if that is the case. > > YiFei Zhu > > > On Wed, Jun 24, 2020 at 10:16 PM Roy Smith wrote: >> >> I'm running a web server with "webservice --backend=kubernetes python3.7". >> As I tail the uwsgi.log fi

Re: [Cloud] Slow uWSGI logging

g the data... > > YiFei Zhu > > On Thu, Jun 25, 2020 at 8:12 AM Roy Smith wrote: >> >> https://tools.wmflabs.org/spi-tools/spi/ >> >> To generate a request, click the "Sock Info" button or the "Index" link. >> >> The log file is

Re: [Cloud] Slow uWSGI logging

https://phabricator.wikimedia.org/T256426 <https://phabricator.wikimedia.org/T256426> > On Jun 25, 2020, at 4:00 PM, YiFei Zhu wrote: > >> Should I open a phab ticket on this? > > Yes please. > > On Thu, Jun 25, 2020 at 2:55 PM Roy Smith wrote: >> >

Re: [Cloud] Toolforge: new domain toolforge.org

I've started getting: > Invalid HTTP_HOST header: 'spi-tools-dev.toolforge.org'. You may need to add > 'spi-tools-dev.toolforge.org' to ALLOWED_HOSTS. I assume that's related to the change? > On Jul 7, 2020, at 6:50 AM, Arturo Borrero Gonzalez > wrote: > > On 2020-07-06 17:59, Arturo Borre

Re: [Cloud] Toolforge: new domain toolforge.org

do with allowed hosts? What are allowed hosts and where are > they configured? > > Thanks, > -Travis > > On Tue, Jul 7, 2020 at 7:02 AM Martin Urbanec <mailto:martin.urba...@wikimedia.cz>> wrote: > Yes, you need to add the host to the allowed hosts. > > Mar

[Cloud] Where to look up my oauth tokens?

I've got several oauth tokens that I registered for a while ago. I have the actual tokens, but where I can I look up the details like whether I registered them as owner-only, etc? ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (f

Re: [Cloud] Where to look up my oauth tokens?

Yup, that's exactly what I was looking for. Thanks. > On Jul 9, 2020, at 8:56 PM, Bryan Davis wrote: > > On Thu, Jul 9, 2020 at 5:29 PM Roy Smith wrote: >> >> I've got several oauth tokens that I registered for a while ago. I have the >> actual

Re: [Cloud] Where to look up my oauth tokens?

deleted? Is there such a thing as a "read-only" consumer? For what I want to do, I'll never want my app to do any edits. It would make sense to get a read-only consumer key, if such a thing existed. > On Jul 9, 2020, at 7:29 PM, Roy Smith wrote: > > I've got

[Cloud] What to do with obsolete oauth consumer keys?

I've created a handful of keys, experimenting the various configs. Now that I've figured out what I need, I have a bunch of old consumers that I don't need any more. Is there anything I should do to revoke them? ___ Wikimedia Cloud Services mailing

[Cloud] Logging vis-a-vis WMF privacy policy?

Is there any specific guidance for what's appropriate or not appropriate for my tool to be logging? I'm using OAUTH, so my tool knows the identity of the user. I assume I don't want to be logging that. Or, is it OK, as long as the logs stay within toolforge? For debugging purposes, I'd like

Re: [Cloud] Logging vis-a-vis WMF privacy policy?

Yup, I'm using django. I was not previously aware of django-log-request-id, but that looks like exactly what I had in mind, so probably what I'll use. Thanks for the pointer. > On Jul 28, 2020, at 2:51 PM, Bryan Davis wrote: > > You did > not mention a specific language that you are using, b

[Cloud] Parsoid APIs?

I know there's been a ton of work done of Parsoid lately. This is great, and the amount of effort that's gone into this functionality is really appreciated. It's clear that Parsoid is the way of the future, but the documentation of how you get a Parsoid parse tree via an AP call isI kind of co

Re: [Cloud] Parsoid APIs?

. I think the biggest thing that could be done to improve the documentation is to update https://www.mediawiki.org/wiki/Parsoid/API <https://www.mediawiki.org/wiki/Parsoid/API>. That's the page you get to most directly when searching for parsoid documentation. > On Sep 7, 202

Re: [Cloud] Parsoid APIs?

ong". > On Sep 10, 2020, at 11:38 AM, Subramanya Sastry wrote: > > HI Roy, > > Sorry it took a while before we could respond. > On 9/4/20 12:40 PM, Roy Smith wrote: >> I know there's been a ton of work done of Parsoid lately. This is great, >> and the

Re: [Cloud] Parsoid APIs?

Thank you. That would have definitely kept me from getting off on the wrong track. > On Sep 11, 2020, at 1:16 PM, Subramanya Sastry wrote: > > See https://www.mediawiki.org/wiki/Parsoid/API > <https://www.mediawiki.org/wiki/Parsoid/API> now. -Subbu. > On 9/10/20 10:5

Re: [Cloud] Python3.7

It would be really good if the bastions could be updated to something more modern, so we could have a uniform python infrastructure everywhere. I think I once opened a phab ticket for this, which was closed as some variation on infeasible. I ran into exactly the issue described below myself.

Re: [Cloud] Python3.7

> On Oct 7, 2020, at 4:04 PM, Bryan Davis wrote: > > On Wed, Oct 7, 2020 at 11:54 AM Roy Smith wrote: >> >> It would be really good if the bastions could be updated to something more >> modern, so we could have a uniform python infrastructure everywhere. I &g

Re: [Cloud] Python3.7

> On Oct 7, 2020, at 7:28 PM, Bryan Davis wrote: > > This may actually be the root of some of your frustrations. Toolforge > is not meant to be a replacement for a development environment on your > local laptop or other server. Hmmm. That's not the impression I got from reading what's availabl

Re: [Cloud] Python3.7

that, how would you set up your development and production environments, given the current state of Toolforge? > On Oct 7, 2020, at 8:16 PM, Roy Smith wrote: > >> On Oct 7, 2020, at 7:28 PM, Bryan Davis > <mailto:bd...@wikimedia.org>> wrote: >> >> This m

Re: [Cloud] [Cloud-announce] tools bastion downtime on Monday, 2020-10-19 at 14:00 UTC

There was some talk a while ago about an upgrade which would reduce NFS latency between the bastions and the k8s cluster. Is that what this is? > On Oct 15, 2020, at 3:11 PM, Andrew Bogott wrote: > > On Monday at 14:00 UTC I'll be moving both toolforge bastions to the new > storage backend.

Re: [Cloud] [Cloud-announce] tools bastion downtime on Monday, 2020-10-19 at 14:00 UTC

0/15/20 2:47 PM, Roy Smith wrote: >> There was some talk a while ago about an upgrade which would reduce NFS >> latency between the bastions and the k8s cluster. Is that what this is? > > I'm not sure what that refers to -- maybe upgrading the NFS server's network >

[Cloud] password for thanos?

I'm trying to connect to https://thanos.wikimedia.org/ . It's asking for my "Wikimedia Developer Username" and password, but I'm not sure which credentials it wants. Is this the same username I use to log into my shell account on dev.tools.wmflabs.org

Re: [Cloud] password for thanos?

Thanks. Backing up a step, what I'm looking to do is build some kind of performance and monitoring dashboard for my tool. From what you say, maybe Thanos is not the right thing for that? > On Dec 15, 2020, at 12:25 PM, Bryan Davis wrote: > > On Tue, Dec 15, 2020 at 10:18 AM Ro

[Cloud] URL length limit for toolforge?

The the following (absurdly long) URL: > https://spi-tools-dev.toolforge.org/spi/timeline/MariaJaydHicky?users=Love2shop2020&users=DHA1398&users=Liberationthetruth&users=143.244.39.180&users=Tanittaking&users=Blumoone&users=Rashawnna&users=Samanda1013&users=Aisleyene&users=Samanda13&users=Inonuchi

Re: [Cloud] URL length limit for toolforge?

api.html#more_itertools.time_limited> which I'm sure will come in handy here. > On Dec 16, 2020, at 10:50 PM, Bryan Davis wrote: > > On Wed, Dec 16, 2020 at 6:04 PM Roy Smith <mailto:r...@panix.com>> wrote: >> >> The the following (absurdly long) URL: >>

[Cloud] {dev,login}.tools.wmflabs.org ssh down?

Is there a problem with SSH on {dev,login}.tools.wmflabs.org ? I can ping both of those hosts, but SSH is not responding for me. ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wiki

Re: [Cloud] [Cloud-announce] new Cloud VPS feature: attachable block storage

If it's on its own file system, df, rather than du, is your friend. > On Feb 5, 2021, at 11:21 PM, Andrew Bogott wrote: > > [0] So big that I don't know how big it is because I ran 'du' and gave up > after it sat there for 40 minutes ___ Wikimedia Cl

[Cloud] X_REQUEST_ID?

I'm running a django app under toolforge. I see there's already a X_REQUEST_ID: e9ec1899b09244939d22c2387db3b75a header in the incoming request. That's totally cool, but I don't see it documented in the toolforge docs. is that something the toolforge infrastructure guarantees will be there?

Re: [Cloud] X_REQUEST_ID?

xuri <https://github.com/roysmith/haproxy-xuri>). The haproxy folks didn't pick up my patch, but I see they did eventually implement their own version. > On Feb 16, 2021, at 11:54 AM, Bryan Davis wrote: > > On Sun, Feb 14, 2021 at 8:43 AM Roy Smith wrote: >> &

[Cloud] tmpfs for tool account?

My personal account has an entry in /run/user: drwx-- 4 roysmith wikidev 80 Jan 14 14:04 /run/user/17980 but not my tool account. Is it possible to set one up for tool accounts? ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (

Re: [Cloud] tmpfs for tool account?

I should have mentioned I'm talking about tools-sgebastion-08. > On Feb 19, 2021, at 2:28 PM, Roy Smith wrote: > > My personal account has an entry in /run/user: > > drwx-- 4 roysmith wikidev 80 Jan 14 14:04 /run/user/17980 > > but not my tool account. Is it

[Cloud] Install emacs 25 on bastion hosts?

Not sure if this is the right place to ask, but would it be possible to install emacs-25 on the bastion hosts? Apparently, the python mode in emacs-25 knows about the new python-3.5 asyncio keywords (async def, etc), but emacs-24 doesn't. One of these looks like the right thing: emacs25-lucid

Re: [Cloud] Install emacs 25 on bastion hosts?

Should I open a phab ticket for requests like this? > On Mar 19, 2021, at 10:02 PM, Roy Smith wrote: > > Not sure if this is the right place to ask, but would it be possible to > install emacs-25 on the bastion hosts? Apparently, the python mode in > emacs-25 knows about the

Re: [Cloud] [Cloud-announce] New Wikireplicas available, timeline update, and Quarry migration

Is it feasible to do a log analysis of the database servers to find out what tools are (were?) using cross-wiki joins? At least that would ensure that all the tool owners could be contacted directly to make sure they know this is happening. > On Mar 31, 2021, at 3:46 PM, Joaquin Oltra Hernande

Re: [Cloud] [Cloud-announce] New Wikireplicas available, timeline update, and Quarry migration

I'm just playing around on tools-sgebastion-08. I can dump the first 1 million image names about half a minute: > tools.spi-tools-dev:xw-join$ time mysql --defaults-file=$HOME/replica.my.cnf > -h commonswiki.web.db.svc.wikimedia.cloud commonswiki_p -N -e 'select > img_name from image limit 10

Re: [Cloud] [Cloud-announce] New Wikireplicas available, timeline update, and Quarry migration

t; > >> On Mar 31, 2021, at 5:18 PM, Roy Smith > <mailto:r...@panix.com>> wrote: >> >> I'm just playing around on tools-sgebastion-08. I can dump the first 1 >> million image names about half a minute: >> >>> tools.s

Re: [Cloud] [Cloud-announce] New Wikireplicas available, timeline update, and Quarry migration

tory work, or should I create a new project? > On Mar 31, 2021, at 10:35 PM, Roy Smith wrote: > > Thanks for looking into this. I tried this again a little later, and it ran > fine. Odd that the amount of memory used depends on the number of rows. I > would expect it would stream r

[Cloud] Publishing out of a VPS node?

I've computed some data on a VPS node that I want to show to people. Is there some quick and dirty way to publish a file so it's visible to the outside? I'm thinking something along the lines of a public_html directory. ___ Wikimedia Cloud Services ma

Re: [Cloud] Publishing out of a VPS node?

od userdir > mkdir ~/public_html/ > > copy files to public_html as you already mentioned > > then click in Horizon to create a proxy, select a name and the > instance it should point to > access data under that name + /~username/ > > On Sat, Apr 17, 2021 at 3:27 PM Roy Smi

Re: [Cloud] Publishing out of a VPS node?

prefork > Failing that, what's the name of your instance and project? I can probably > sort it out for you > > On Sun, 18 Apr 2021 at 13:30, Roy Smith <mailto:r...@panix.com>> wrote: > Hmmm, it turns out, this doesn't work. Apache fails to start with: > > AH0

[Cloud] NFS bandwidth to VPS nodes?

I'm exploring various ways of working with the XML data dumps on /publib/dumps/public/enwiki. I've got a process which runs through all of the enwiki-20210301-pages-articles[123456789]*.xml* files in about 6 hours. If I've done the math right, that's just about 18 GB of data, or 3 GB/h, or 8 M

Re: [Cloud] [Cloud-announce] cloud-vps maintenance at 14:00 UTC

I'm getting timeouts and 502's on both https://spi-tools.toolforge.org/ and https://spi-tools-dev.toolforge.org/ . Also: ssh: connect to host dev.tools.wmflabs.org port 22: Network is unreachable Could the VPS work be cau

[Cloud] Hibernating a VM?

I've got a VM (spi-tools-host-1) that I'm not actively using right now. I could shut it down to release the CPU resources, but I want to be able to start it back up again at some point in the future with the same configuration. On AWS I would just back up all the storage and shut down the VM.

[Cloud] Re: Hibernating a VM?

Looking in https://horizon.wikimedia.org/project/instances/43d3e9f2-b7d5-4a51-92b6-6a636839d66f/ , I also see "Shelve Instance"; what does that do? I'm actually kind of curious about that last one because

[Cloud] Re: Hibernating a VM?

your server is in 'shelving' status, so it sholud be waiting for it > to shut off, once that happens it will > consider it as shelved. > If it's still running in a while feel free to open a ticket so we do some > debugging. > > Cheers! > > > On 06/07 09:50

[Cloud] Validating multiple usernames?

I've got a tool which parses sockpuppet investigation (SPI) pages and does some analysis. One of the steps is I need to validate that all of the usernames found in the SPI report are valid. I do that by sequentially calling usercontribs on each name with uclimit=1 and seeing if I get a baduser

[Cloud] Re: Validating multiple usernames?

Ah, cool. That's exactly what I was looking for, thanks. > On Aug 19, 2021, at 6:21 PM, Bryan Davis wrote: > > On Thu, Aug 19, 2021 at 4:04 PM Roy Smith wrote: >> >> I've got a tool which parses sockpuppet investigation (SPI) pages and does >> some ana

[Cloud] Re: Validating multiple usernames?

at context since it can't map it to a userid. I can work around this, but mentioning it for the sake of some poor developer searching the archives N years from now trying to figure it out :-) > On Aug 19, 2021, at 6:21 PM, Bryan Davis wrote: > > On Thu, Aug 19, 2021 at 4:04 PM Roy Smi

[Cloud] Re: Validating multiple usernames?

{ "name" : "Roysmith", "missing" : "" } ] }, "batchcomplete" : "" } I'm assuming the entries in the returned "users" list are guaranteed to be in the same order a

  1   2   >