We do not use Jenkins but we do have self-hosted runners in Airflow - we use VMS and auto-scaling groups rather than ECS or EKS, no GPU nodes though, so I am not sure how it would be useful. But we are looking into using EKS instead at some point, so maybe that's a good opportunity to try it out by us as well (we could try it for GitHub actions integration in this case).
I am also on asf-infra. J. On Fri, Dec 31, 2021 at 5:46 AM Janardhan Pulivarthi <janardhan.pulivar...@gmail.com> wrote: > > I have some experience with it. > > For Apache SystemDS we use GPU based self hosted runner on AWS ec2 at the > moment. Would like make use of this infrastructure. > > Find me on asf-infra slack! > > Best, > Janardhan > > > On Friday, December 31, 2021, Chris Lambertus <c...@apache.org> wrote: > > > Hi folks, > > > > We have some funding to explore providing ephemeral builds via ECS or EKS > > in the Amazon ecosystem, but Infra does not have expertise in this area. We > > would like to integrate such a service with Jenkins. > > > > Does anyone have experience with using these services for CI, and would > > you be interested in assisting Infra in developing a prototype? > > > > Additionally, we may be able to provide some build nodes with GPUs. Do we > > have projects which could/would make use of GPUs for integration testing? > > > > Thanks, > > -Chris > > ASF Infra > > > >
