Re: [Cloud] Emulate cross-wiki joins

2018-01-17 Thread YiFei
SELECT ... FROM ``.``, like in https://quarry.wmflabs.org/query/24212. This should work in the foreseeable future, during which all the replica databases are accessible on the same server. Zhuyifei1999 2018-01-17 14:11 GMT-06:00 Federico Leva (Nemo) : > I usually use bash or python scrips to que

Re: [Cloud] Emulate cross-wiki joins

2018-01-18 Thread YiFei
future//. (Yes, changing is a possibility but it’s not currently foreseeable whether or when it will happen.) [1] https://phabricator.wikimedia.org/T76466 Zhuyifei1999 On Thu, Jan 18, 2018 at 9:39 AM Brad Jorsch (Anomie) wrote: > On Wed, Jan 17, 2018 at 5:50 PM, YiFei wrote: > >> SEL

Re: [Cloud] Emulate cross-wiki joins

2018-01-18 Thread YiFei
the only way to get the desired results), yet > "we shouldn't have done it"... Don't fall into the same trap. > > On Thu, Jan 18, 2018 at 10:28 AM YiFei wrote: > >> Well, you are free to suggest a better advice. In the case of shards >> splitting into diffe

Re: [Cloud] Webservice failures (Toolforge)

2020-01-26 Thread YiFei
Would you mind giving me a ping when it fails? I will see if I can find anything with ptrace (strace / gdb). It might be slightly easier to debug if it's running on grid so I don't have to mess with Linux namespaces. YiFei Zhu On Sun, Jan 26, 2020 at 9:57 AM Russell Blau wrote: &g

Re: [Cloud] Webservice down

2020-01-31 Thread YiFei
Please create a ticket on Phabricator and assign it to me. I will log all my findings there. YiFei Zhu On Fri, Jan 31, 2020 at 3:23 PM David Richfield wrote: > OK, this tool is still crashing, and I need help understanding what to > debug. Is it the PHP script? I don't know enough P

Re: [Cloud] Need help with selectize.js

2020-06-24 Thread YiFei
Honestly, I don't see any downsides to just keeping the attributes. Integrity validation is a valid defense and if it's blocked for some reason that should be fixed on our side. YiFei Zhu On Wed, Jun 24, 2020, 10:11 MusikAnimal wrote: > I wouldn't think you'd need an

Re: [Cloud] Slow uWSGI logging

2020-06-24 Thread YiFei Zhu
My guess is output stream buffering, at either the libc level or the python level. Which tool is this? I can probably strace and see if that is the case. YiFei Zhu On Wed, Jun 24, 2020 at 10:16 PM Roy Smith wrote: > > I'm running a web server with "webservice --backend=kube

Re: [Cloud] Slow uWSGI logging

2020-06-25 Thread YiFei Zhu
I use `tail -f` on the uwsgi host. Looks like the kernel is buffering the data... YiFei Zhu On Thu, Jun 25, 2020 at 8:12 AM Roy Smith wrote: > > https://tools.wmflabs.org/spi-tools/spi/ > > To generate a request, click the "Sock Info" button or the "Index" link. &

Re: [Cloud] Slow uWSGI logging

2020-06-25 Thread YiFei Zhu
> Should I open a phab ticket on this? Yes please. On Thu, Jun 25, 2020 at 2:55 PM Roy Smith wrote: > > Heh, my mail about NFS being involved cross paths with yours. Thanks for > digging into this for me. > > Should I open a phab ticket on this? > > > > On Jun 2

[Cloud] Re: Porting the output of qstat to a web page

2021-05-11 Thread YiFei Zhu
02:25:36 0 ✓ zhuyifei1999@tools-sgebastion-08: ~$ sudo -- sudo -Hu tools.huji kubectl exec -it huji-[..] /bin/bash tools.huji@huji-[...]:~$ qstat bash: qstat: command not found You must run on the grid to talk to the grid. YiFei Zhu ___ Wikimedia Cloud S

[Cloud] Re: Source command not working with zsh

2021-11-12 Thread YiFei Zhu
tin [2] so I have no idea how it's breaking for you. Somehow your scripts are being run by dash if you have `exec zsh`, but since I don't know how you are invoking the scripts I cannot trace the code. YiFei Zhu [1] https://man7.org/linux/man-pages/man1/dot.1p.html [2] https://sourceforg

[Cloud] Re: Source command not working with zsh

2021-11-14 Thread YiFei Zhu
On Fri, Nov 12, 2021 at 6:58 PM Huji Lee wrote: > > I had the chance to try out these options. > > YiFei was right in that the scripts, when invoked by crontab after zsh was > activated, were being invoked by sh and that was why the source command was > not working. >

[Cloud] Re: Source command not working with zsh

2021-11-17 Thread YiFei Zhu
o, if you explicitly run `bash`, you want bash not zsh. - Interactive login shells. Yes, this is what `become tool` runs initially and you want bash here. Hence, to run in a login shell environment you'd want the .profile or .bash_profile. And interactive guard is simply [[ $- = *i* ]] in bas

[Cloud] Re: Source command not working with zsh

2021-11-23 Thread YiFei Zhu
On Wed, Nov 17, 2021 at 1:04 AM YiFei Zhu wrote: > On Tue, Nov 16, 2021 at 6:38 PM Huji Lee wrote: > > > > I went back and reactivated the line in .bash_profile which enabled zsh > > ("exec zsh" as the last line of .bash_profile) > > > > Then I sub

[Cloud] Re: Source command not working with zsh

2021-12-04 Thread YiFei Zhu
f I find any evidence otherwise. Sounds good to me YiFei Zhu > On Tue, Nov 23, 2021 at 12:06 PM YiFei Zhu wrote: >> >> On Wed, Nov 17, 2021 at 1:04 AM YiFei Zhu wrote: >> > On Tue, Nov 16, 2021 at 6:38 PM Huji Lee wrote: >> > > >> > > I

[Cloud] Re: Mounting Toolforge on local Linux machine

2021-12-25 Thread YiFei Zhu
This? $ sshfs login.toolforge.org:/data/project/toolname /path/to/mountpoint YiFei Zhu On Sat, Dec 25, 2021 at 6:39 PM Huji Lee wrote: > > Hi all, > > I had previously found a way to mount the home directory of my tool on > Toolforge onto my local Linux machine using a mount

[Cloud] Re: What do y'all use Dumps for?

2024-10-08 Thread YiFei Zhu
On Tue, Oct 8, 2024 at 8:59 AM Bryan Davis wrote: > > I was asked recently what I knew about the types of tools that use > data from the https://dumps.wikimedia.org/ project. I had to admit > that I really didn't know of many tools off the top of my head that > relied on dumps. Most of the use cas