Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-08 Thread Jarek Potiuk
> > > That's a good idea. We do need to thank Github to give free resources to > ASF projects, but it's better if we can make it a business: we allow > individual projects to sign deals with Github to get dedicated resources. > It's a bit wasteful to ask every project to set up its own dev ops, > u

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-08 Thread shane knapp ☠
On Wed, Apr 7, 2021 at 6:30 AM Hyukjin Kwon wrote: > Thanks Martin for your feedback. > > > What was your reason to migrate from Apache Jenkins to Github Actions ? > > I am sure there were more reasons for migrating from Amplap Jenkins > to GitHub Actions

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Hyukjin Kwon
- builds FYI, cc'ing Spark dev was dropped during the discussion. If you haven't subscribed to builds@a.g, you have seen the partial discussions only. Please subscribe bui...@apache.org mailing list to participate in the discussion further. 2021년 4월 8일 (목) 오후 1:50, Wenchen Fan 님이 작성: > > for ex

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Wenchen Fan
> for example, having sub-groups where each group shares the resources - currently one GitHub organisation shares all resources across the projects. That's a good idea. We do need to thank Github to give free resources to ASF projects, but it's better if we can make it a business: we allow individ

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Hyukjin Kwon
Thanks Martin for your feedback. > What was your reason to migrate from Apache Jenkins to Github Actions ? I am sure there were more reasons for migrating from Amplap Jenkins to GitHub Actions but as far as I can remember: - To reduce the maintenance cost

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Martin Grigorov
On Wed, Apr 7, 2021 at 3:41 PM Hyukjin Kwon wrote: > Hi Greg, > > I raised this thread to figure out a way that we can work together to > resolve this issue, gather feedback, and to understand how other projects > work around. > Several projects I observed, as far as I can tell, have made enough

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Hyukjin Kwon
Hi Greg, I raised this thread to figure out a way that we can work together to resolve this issue, gather feedback, and to understand how other projects work around. Several projects I observed, as far as I can tell, have made enough efforts to save the resources in GitHub Actions but still suffer

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Greg Stein
On Wed, Apr 7, 2021 at 12:25 AM Hyukjin Kwon wrote: > Hi all, > > I am an Apache Spark PMC, You are a member of the Apache Spark PMC. You are *not* a PMC. Please stop with that terminology. The Foundation has about 200 PMCs, and you are a member of one of them. You are NOT a "PMC" .. you're a p

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Jarek Potiuk
Just a comment here - as I commented also in the ticket The document https://cwiki.apache.org/confluence/display/BUILDS/GitHub+Actions+status gives complete overview of where the Github Actions are for the ASF project. And we have some nice experiences in Apache Airflow that we will be able to