Re: GA again unreasonably slow (again)

2021-02-08 Thread Antoine Pitrou
Hi Jarek, Thank you for the document. Could you tell us more about the "custom security layer" that you implemented? Regards Antoine. Le 08/02/2021 à 01:44, Jarek Potiuk a écrit : > For anyone following this thread - some update from the progress we have in > Airflow on building self-hosted

Re: GA again unreasonably slow (again)

2021-02-08 Thread Jarek Potiuk
This uses https://github.com/actions/runner/pull/783 to not have un-trusted users run code (security is based on the actors of the commit - commiter’s PRs and direct pushes are allowed to run builds on self-hosted runners) on our hosts, and then a combination of a Github Application, AWS Lambda a

Re: GA again unreasonably slow (again)

2021-02-08 Thread Chris Lambertus
> On Feb 8, 2021, at 1:51 PM, Jarek Potiuk wrote: > > This uses https://github.com/actions/runner/pull/783 to not have > un-trusted users run code (security is based on the actors of the commit - > commiter’s PRs and direct pushes are allowed to run builds on self-hosted > runners) on our hos

Re: GA again unreasonably slow (again)

2021-02-08 Thread Jarek Potiuk
The preliminary description (Still lacking some recent changes and details) is here: https://cwiki.apache.org/confluence/display/INFRA/Self-hosted+GitHub+runners and you can grab Ash as he mentioned in the comments if you want to get some more details on it . On Mon, Feb 8, 2021 at 11:01 PM Chris

Re: GA again unreasonably slow (again)

2021-02-08 Thread Allen Wittenauer
> On Feb 7, 2021, at 4:44 PM, Jarek Potiuk wrote: > > If you are interested - my document is here. Open for comments - happy to > add you as editors if you want (just send me your gmail address in priv). > It is rather crude, I had no time to put a bit more effort into it due to > some signific

Re: [Hosting] Mail Relay Migration (smtp3) - Mon, Feb 8, 2021, 2:15-4:45pm PST (2215-0045 UTC)

2021-02-08 Thread Lance Albertson
This migration has been completed and as far as we know everything is working as expected. Please let us know via email, IRC, or twitter if something doesn't seem correct. Thanks- On Fri, Feb 5, 2021 at 3:53 PM Lance Albertson wrote: > All, > > Service(s) affected: smtp3 mail relay migration >

Re: GA again unreasonably slow (again)

2021-02-08 Thread Jarek Potiuk
> I'm not convinced this is true. I have yet to see any of my PRs for "non-big" projects getting queued while Spark, Airflow, others are. Thus why I think there are only a handful of projects that are getting upset about this but the rest of us are like "meh whatever." Do you have any data on th

[Hosting] Network Issues

2021-02-08 Thread Lance Albertson
We've been getting quite a bit of alerts from Pingdom regarding our network since around 7:30PM PST (0330 UTC). We have not gotten any notifications from our upstream, but looking at their graphs, it seems they might be having an issue with one of their paths. We'll keep you posted if this continu

Re: [Hosting] Network Issues

2021-02-08 Thread Lance Albertson
I got the following update from our upstream: "Yes, we’re experiencing some routing issues with our upstream providers. We’re working on resolving the issues right now." On Mon, Feb 8, 2021 at 7:56 PM Lance Albertson wrote: > We've been getting quite a bit of alerts from Pingdom regarding our >

Re: GA again unreasonably slow (again)

2021-02-08 Thread Allen Wittenauer
> On Feb 8, 2021, at 5:00 PM, Jarek Potiuk wrote: > >> I'm not convinced this is true. I have yet to see any of my PRs for > "non-big" projects getting queued while Spark, Airflow, others are. Thus > why I think there are only a handful of projects that are getting upset > about this but the