Great, thanks!
On Tue, Nov 9, 2021 at 12:46 PM Gavin McDonald <gmcdon...@apache.org> wrote: > > Hi Craig, > > This meeting (and most builds meetings) is open to all, I have added > you to the guest list. > > Keep an eye out on Thursday where I'll add the meeting id to the builds@ > list > and the wiki page. > > > > On Tue, Nov 9, 2021 at 6:12 PM Craig Hunt <m...@craighunt.us> wrote: > > > Gavin, I am a new potential volunteer with a strong interest in ASF > > GitBox CI/CD build operations and would like to attend your meeting > > strictly as an observer (knowledge gain exercise). > > Greg Stein confirmed by email that he thought it may be OK for me to > > attend if the meeting was public. > > However, I am not clear if the meeting is public, as I first thought, > > if it is can I be added as a guest observer? I cannot add myself on > > Confluence it seems. > > I know there are good reasons for security now and I have NO essential > > need as a potential volunteer to attend, so please let me know your > > policy preference. > > Best regards, Craig Richard Hunt > > > > > > On Tue, Nov 9, 2021 at 2:15 AM Gavin McDonald <gmcdon...@apache.org> > > wrote: > > > > > > Reminder to all that the builds@ meeting will take place this week, in 2 > > > days. > > > > > > Hope you can all make it! > > > > > > Gav... > > > > > > > > > On Thu, Nov 4, 2021 at 8:58 AM Gavin McDonald <gmcdon...@apache.org> > > wrote: > > > > > > > Hi All. > > > > > > > > It seems next week is better for some so I'll push this out to the > > 11th. > > > > > > > > HTH > > > > > > > > On Mon, Nov 1, 2021 at 4:08 PM Josh Fischer <j...@joshfischer.io> > > wrote: > > > > > > > >> I'm interested in participating. The Heron project is hitting limits > > > >> with TravisCI, I'd like to find a way to make our process better > > whether > > > >> it's with Jenkins/GA or something else. Next week would be better for > > me, > > > >> if we can push it back. > > > >> > > > >> On Mon, Nov 1, 2021 at 8:49 AM Jarek Potiuk <ja...@potiuk.com> wrote: > > > >> > > > >>> I updated the graphs. I think things have changed a lot since > > December > > > >>> last > > > >>> year. > > > >>> > > > >>> There are no absurd-high (and way above the limits) peaks of > > workflows in > > > >>> progress for some projects (e.g. Pulsar). However a number of apache > > > >>> repos > > > >>> using GA grows steadily. Number of workflows "queued" fluctuates for > > many > > > >>> projects and for some projects (spark) it seems it steadily grows. > > > >>> > > > >>> Observation from the Airflow side (and I think lack of "escalation" > > > >>> indicates that other projects have the same) is that we stopped > > observing > > > >>> prolonged periods where a lot of jobs are queued for a long time > > (many > > > >>> hours). One thing is that we moved a lot of the workload to our > > > >>> self-hosted > > > >>> runners - when it comes to public runners, there are short peaks of > > > >>> queued > > > >>> jobs but they seem to catch-up relatively quickly (max few hours). > > > >>> > > > >>> When I see those graph, my interpretation is that Github got a lot > > better > > > >>> queuing algorithms.Previously it seemed to be possible by a single > > > >>> project > > > >>> to take over the queue and get the number of "in progress" way higher > > > >>> than > > > >>> the 150 jobs limit, and I think that effectively blocked other > > projects > > > >>> for > > > >>> a long time. Currently it seems that the algorithm they have > > balances out > > > >>> the workload between projects much better - and if there are projects > > > >>> that > > > >>> have more and more workloads, it impacts their own queue size much > > more > > > >>> than queuing time of other projects - see Spark's average number of > > > >>> queued > > > >>> workflows. > > > >>> > > > >>> The graphs IMHO are much healthier than they were a year ago. > > > >>> > > > >>> I wonder what is the perception of others :). > > > >>> > > > >>> BTW. It would be great if we could move it by a week - this week is > > > >>> shorter > > > >>> for many and some have longer holidays (1st of Nov is a holiday in a > > > >>> number > > > >>> of countries). > > > >>> > > > >>> On Mon, Nov 1, 2021 at 2:13 PM Gavin McDonald <gmcdon...@apache.org> > > > >>> wrote: > > > >>> > > > >>> > Hi All, > > > >>> > > > > >>> > I think it is past time to have another meeting. > > > >>> > The stresses and strains of our current CI makes me think we should > > > >>> have > > > >>> > another discussion. > > > >>> > > > > >>> > Link to the cwiki page: > > > >>> > > > > >>> > > > > >>> > > https://cwiki.apache.org/confluence/display/INFRA/Builds+Agenda+2021-11-04 > > > >>> > > > > >>> > If this week doesn't work then we can postpone until next week. > > > >>> > > > > >>> > HTH > > > >>> > > > > >>> > -- > > > >>> > > > > >>> > *Gavin McDonald* > > > >>> > Systems Administrator > > > >>> > ASF Infrastructure Team > > > >>> > > > > >>> > > > >> > > > > > > > > -- > > > > > > > > *Gavin McDonald* > > > > Systems Administrator > > > > ASF Infrastructure Team > > > > > > > > > > > > > -- > > > > > > *Gavin McDonald* > > > Systems Administrator > > > ASF Infrastructure Team > > > > > -- > > *Gavin McDonald* > Systems Administrator > ASF Infrastructure Team
