Hi Jarek, One data point for this thread. Infra’s GitHub Actions policy asks for a cap on workflows at 20 concurrent jobs: https://infra.apache.org/github-actions-policy.html
The Tests (AMD) workflow goes over it. In its last 20 completed runs it peaked at 40 jobs at once, and 12 of the 20 went over 20. I counted only jobs that got a runner, so queued jobs that were cancelled are not included. In one successful PR run this morning, 30 jobs from 17 test groups were running at the same time: https://github.com/apache/airflow/actions/runs/37899638118 The cause is that ci-amd.yml calls many reusable workflows, and each matrix sets max-parallel: 20 on its own. Each matrix stays under the limit, but they run side by side and add up. GitHub has no setting that caps the whole workflow that I'm aware of. Thanks, Justin --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
