On Thu, Aug 20, 2015 at 6:32 AM, Gavin McDonald <gmcdon...@apache.org> wrote: > >> On 20 Aug 2015, at 2:18 am, David Nalley <da...@gnsa.us> wrote: >> >> <snip> > >> ...how many additional >> build nodes/executors will satiate our current demand for capacity? > > I know this was not aimed at me but I’ll give my opinion. > > From what I’ve seen of the current growth over the last year; and to allow for > future expansion over the next 2 years I would look to get another 20 static > slave machines/vms , each running 2 executors. >
Just for some perspective keep in mind that we are 4 months into the current budget year. The total hardware/cloud budget for all of the ASF is 90k. 20 additional physical nodes is a 200k capital outlay if we purchase hardware, and 50k/yr amortized over 4 years, and likely another rack of power and cooling. At RAX that's $4321/month and $51,852/year. The cheapest option would be going to the group Daniel found in France for ELK, while not nearly as flexible as a true cloud system, we could run 20 nodes there for $1500 per month, or $18,000 per year. And that's an increase on what we are currently spending, not the total. We can ask some of our infra sponsors for that, but we need to plan that out, and deal with the risk that involves. We are already heavily dependent on a single sponsor for the vast majority of our physical CI nodes. That said, we really need to understand the demand first before we decide to spend tens or hundreds of thousands of dollars. In many ways, I expected Travis to decrease load on Jenkins, but we continue to expand. It'd be interesting to see graphs of # of jobs over time, how that's increasing, as well as what projects are currently consuming build time. --David
