After the major tree closure[1] last week I wanted to see how it
impacted the tree closure stats (stats below in this email) that I have
been watching. I have also been looking to see how many backouts the
sheriffs are doing and seeing how they correlate. For those interested
the tree closure and backouts track pretty much together[2].
This has led me, and others in the A*Team, to look at how we are doing
with pushes vs backouts. This lead to a similar graph[3] to see how we
are doing there. We are doing roughly the same amounts of backouts vs
pushes each month which obviously leads to what is the ratio.
We appear to be doing 1 backout for every 15 pushes on a rough
average[4]. This number I am sure you can all agree is far too high
especially if we think about the figures that John O'Duinn suggests[5]
for the cost of each push for running and testing. With the offending
patch + backout we are using 508 computing hours for essentially doing
no changes to the tree and then we do another 254 computing hours for
the fixed reland. Note the that the 508 hours doesn't include retriggers
done by the Sheriffs to see if it is intermittent or not.
This is a lot of wasted effort when we should be striving to get patches
to stick first time. Let's see if we can try make this figure 1 in 30
patches getting backed out.
David
[1] https://bugzilla.mozilla.org/show_bug.cgi?id=932781
[2]
https://secure.theautomatedtester.co.uk/owncloud/public.php?service=files&t=34cc10e40556fe7e500c6da889e7640a
[3]
https://secure.theautomatedtester.co.uk/owncloud/public.php?service=files&t=506965b4880639f6fde96d65e735701c
[4]
https://secure.theautomatedtester.co.uk/owncloud/public.php?service=files&t=0661df74023f576202f83343b21f9b4c
[5] http://oduinn.com/blog/2013/09/27/254-compute-hours-per-checkin/
Tree has been closed for a total of 54 days, 15:27:53 since it was
created on 2012-05-14T09:59:46
2012-08 : 1 day, 1:26:57
2012-09 : 1 day, 3:31:16
2012-10 : 2 days, 21:33:14
2012-11 : 20:45:45
2012-12 : 2 days, 1:19:51
2013-01 : 2 days, 8:17:55
2013-02 : 4 days, 0:24:59
2013-03 : 6 days, 3:13:09
2013-04 : 4 days, 17:51:39
2013-05 : 5 days, 13:33:49
2013-06 : 2 days, 15:42:37
2013-07 : 6 days, 13:46:11
2013-08 : 4 days, 5:42:17
2013-09 : 4 days, 20:59:41
2013-10 : 4 days, 21:22:40
2013-11 : 13:55:53
Backouts per month
2012-08 : 172
2012-09 : 145
2012-10 : 202
2012-11 : 156
2012-12 : 187
2013-01 : 200
2013-02 : 177
2013-03 : 260
2013-04 : 215
2013-05 : 222
2013-06 : 204
2013-07 : 273
2013-08 : 260
2013-09 : 288
2013-10 : 259
2013-11 : 43
Pushes per month
2012-08 : 3261
2012-09 : 2653
2012-10 : 3255
2012-11 : 2736
2012-12 : 2683
2013-01 : 3333
2013-02 : 3101
2013-03 : 3434
2013-04 : 3173
2013-05 : 3261
2013-06 : 3335
2013-07 : 4028
2013-08 : 4032
2013-09 : 4164
2013-10 : 3538
2013-11 : 335
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform
