Re: Building with Travis - anyone?

2022-09-01 Thread Antoine Pitrou
We use Travis-CI for a couple non-x86 builds. They seem reasonably stable these days, though it took some time to bring them to that state because of apparently very limited execution resources, leading to timeouts or crashes (especially on s390x). https://app.travis-ci.com/github/apache/ar

Re: GitHub Actions runners

2022-08-26 Thread Antoine Pitrou
Le 26/08/2022 à 13:21, Lari Hotari a écrit : I created a INFRA ticket requesting the usage report for GitHub Actions: https://issues.apache.org/jira/browse/INFRA-23633 This information should be available at https://github.com/organizations/apache/settings/billing for those who have access.

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-18 Thread Antoine Pitrou
Hi Marton, Thanks a lot for the information you have collected and presented. This is very insightful! Le 18/04/2021 à 11:06, Elek, Marton a écrit : There are signs of mis-configuation of some jobs. For example in some projects I found many failure jobs with >15 hours executions even if t

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Antoine Pitrou
I am a member of the Arrow PMC ( ;-) ) and we would gladly welcome a way to contribute - e.g. financially - towards larger CI resources on Github Actions (or another similar online service that can build PRs from forks). While "build more with fewer minutes" is definitely desirable, the bre

Re: Pre-merge CI in apache github repositories

2021-03-09 Thread Antoine Pitrou
Le 09/03/2021 à 09:33, Tristan Van Berkom a écrit : So with that said, I would like to ask the community some questions: o What is the correct way of approaching pre-merge CI for ASF github projects ? If you have "the answer" to this, please provide it and disregard the entire

Re: GA workflow cancellation

2021-02-09 Thread Antoine Pitrou
Le 09/02/2021 à 19:28, Jarek Potiuk a écrit : > Yes. I noticed this misleading line and I will update the docs shortly. It > should be Cancels duplicate runs from all running workflow *runs of the > workflow the action acts on*.""" > > The action is written in the way that it always acts on

Re: GA workflow cancellation

2021-02-09 Thread Antoine Pitrou
Hi Jarek, Le 09/02/2021 à 09:21, Jarek Potiuk a écrit : > And we all together try to help each other (for > example I helped yesterday the Pulsar team to implement most aggressive way > of cancelling their workflows https://github.com/apache/pulsar/pull/9503 > (you can find pretty good explanati

Re: GA again unreasonably slow (again)

2021-02-08 Thread Antoine Pitrou
Hi Jarek, Thank you for the document. Could you tell us more about the "custom security layer" that you implemented? Regards Antoine. Le 08/02/2021 à 01:44, Jarek Potiuk a écrit : > For anyone following this thread - some update from the progress we have in > Airflow on building self-hosted

Re: ASF Jenkins usability [Was: Re: GA again unreasonably slow (again)]

2021-01-09 Thread Antoine Pitrou
Le 09/01/2021 à 12:01, Jarek Potiuk a écrit : > > So if only we had 'approved', "secure" and easy way of running our own > self-hosted runners + a way from Github to distribute the free resources in > a fair way among the project. - the problem would be immediately solved. > This is really what

Re: ASF Jenkins usability [Was: Re: GA again unreasonably slow (again)]

2021-01-08 Thread Antoine Pitrou
Le 08/01/2021 à 22:29, P. Ottlinger a écrit : > Hi Antoine, > > Am 08.01.21 um 22:17 schrieb Antoine Pitrou: >>> What are the gaps in the ASF CI systems that are pushing people onto >> less viable platforms such as GA? >> >> While being a PMC and core deve

Re: ASF Jenkins usability [Was: Re: GA again unreasonably slow (again)]

2021-01-08 Thread Antoine Pitrou
Hi, On Fri, 8 Jan 2021 12:49:03 -0800 Chris Lambertus wrote: > > Have you considered the internal and fully supported ASF Jenkins and/or Buildbot infrastructure? Infra has little control over the free open source offerings, but we have significantly more resources we can bring to bear on own on

Re: GitHub Actions Concurrency Limits for Apache projects

2020-10-13 Thread Antoine Pitrou
On Tue, 13 Oct 2020 14:00:17 +0200 Jarek Potiuk wrote: > > Who else is using GitHub Actions extensively? At Apache Arrow we are using GHA quite intensively as well. We have tens of different builds, which are triggered based on which files were modified. Some of them can be rather long.