Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

Just a comment here - as I commented also in the ticket The document https://cwiki.apache.org/confluence/display/BUILDS/GitHub+Actions+status gives complete overview of where the Github Actions are for the ASF project. And we have some nice experiences in Apache Airflow that we will be able to

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

On Wed, Apr 7, 2021 at 12:25 AM Hyukjin Kwon wrote: > Hi all, > > I am an Apache Spark PMC, You are a member of the Apache Spark PMC. You are *not* a PMC. Please stop with that terminology. The Foundation has about 200 PMCs, and you are a member of one of them. You are NOT a "PMC" .. you're a p

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

I am a member of the Arrow PMC ( ;-) ) and we would gladly welcome a way to contribute - e.g. financially - towards larger CI resources on Github Actions (or another similar online service that can build PRs from forks). While "build more with fewer minutes" is definitely desirable, the bre

Re: Better stability with docker authenticated jenkins agents

> > My understanding is that pulls of all images from the apache/* namespace > are not subject to rate limiting. Thus, the recommendation to move > everything you need inside of it. > As >95% of our CI docker commands are pulls from apache/ images, if rate-limiting is the cause of this (note that

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

Hi Greg, I raised this thread to figure out a way that we can work together to resolve this issue, gather feedback, and to understand how other projects work around. Several projects I observed, as far as I can tell, have made enough efforts to save the resources in GitHub Actions but still suffer

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

On Wed, Apr 7, 2021 at 3:41 PM Hyukjin Kwon wrote: > Hi Greg, > > I raised this thread to figure out a way that we can work together to > resolve this issue, gather feedback, and to understand how other projects > work around. > Several projects I observed, as far as I can tell, have made enough

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

Thanks Martin for your feedback. > What was your reason to migrate from Apache Jenkins to Github Actions ? I am sure there were more reasons for migrating from Amplap Jenkins to GitHub Actions but as far as I can remember: - To reduce the maintenance cost

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

If your project can afford it, you can add self-hosted GHA runners: https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners The issue with that being that the machine running your actions will necessarily have write access to the repository through the API, so you can'

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

śr., 7 kwi 2021, 18:45 użytkownik ocket napisał: > If your project can afford it, you can add self-hosted GHA runners: > > https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners > The issue with that being that the machine running your actions will > necessaril

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

> for example, having sub-groups where each group shares the resources - currently one GitHub organisation shares all resources across the projects. That's a good idea. We do need to thank Github to give free resources to ASF projects, but it's better if we can make it a business: we allow individ

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

> So it all has to start with 'per-project' resource limitation and self- > budgeting. It would be GREAT if infra.could provide self-hosted GitHub > Runners SERVICE per project, where project could donate credits or money > for their own account, then the projects would have incentive to optimize >