Better stability with docker authenticated jenkins agents

2021-04-06 Thread Mick Semb Wever
tl;dr Can and should all jenkins agents be (automatically) docker authenticated, for improved stability around docker commands? This past week the ci-cassandra.apache.org CI fell over because a fair percentage of docker pulls failed. Our pipeline runs a lot of docker containers. In the past week

Re: Better stability with docker authenticated jenkins agents

2021-04-06 Thread Joan Touzet
Hi Mick, On 06/04/2021 06:34, Mick Semb Wever wrote: > tl;dr > Can and should all jenkins agents be (automatically) docker authenticated, > for improved stability around docker commands? > > > This past week the ci-cassandra.apache.org CI fell over because a fair > percentage of docker pulls fai

Re: Better stability with docker authenticated jenkins agents

2021-04-06 Thread Mick Semb Wever
> > > Has anyone experience with such issues before? > > Yes. See https://issues.apache.org/jira/browse/INFRA-20795 for detail. > > In short, once Infra agrees to create the images for us, we'll move all > our CI dependencies into those containers, and should no longer have > issues. > Thanks Joa

Re: Better stability with docker authenticated jenkins agents

2021-04-06 Thread Joan Touzet
On 06/04/2021 18:09, Mick Semb Wever wrote: >> >>> Has anyone experience with such issues before? >> >> Yes. See https://issues.apache.org/jira/browse/INFRA-20795 for detail. >> >> In short, once Infra agrees to create the images for us, we'll move all >> our CI dependencies into those containers,

Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-06 Thread Hyukjin Kwon
Hi all, I am an Apache Spark PMC, and would like to know the future plan about GitHub Actions in ASF. Please also see the INFRA ticket I filed: https://issues.apache.org/jira/browse/INFRA-21646. I am aware of the limited GitHub Actions resources that are shared across all projects in ASF, and man