Hi, i agree with Sebastian - the integration of submitting to try and getting the results in mozreview helps i think a lot.
Also this is all great feedback and will add a more detailed area about backouts (where they happen like inbound/autoland, and reason) in the next sheriff monthly report. Cheers, - Tomcat On Tue, Mar 7, 2017 at 1:27 PM, Sebastian Hengst <a...@gmx.de> wrote: > Mozreview shows the results of Try pushes (if they have been requested) > near the top where also the landing can be requested which makes it less > likely that issues get missed (pushing to Try and not checking the results > is not that rare). > > Mozreview is also the only repository to which the person who gets backed > out the most (my subjection impression) pushes to (doesn't mean the second > push will stick). > > Inbound is also often used for platform-wide changes which might have > bitrotted between the Try push and the push to inbound. > > Sebastian > > -------- Original-Nachricht -------- > Betreff: Re: [Sheriffs] Sheriff Highlights and Summary in February 2017 > Von: David Burns <dbu...@mozilla.com> > Datum: 2017-03-07 12:23 > >> One thing that we have also noticed is that the backout rate on autoland >> is lower than inbound. >> >> In the last 7 days backout rate is averaging (merges have been removed): >> >> * Autoland 6%.(24 backouts out of 381 pushes) >> * Inbound 12% (30 backouts out of 251 pushes) >> >> I don't have graphs to show this but when I look at >> https://futurama.theautomatedtester.co.uk/ <https://futurama.theautomated >> tester.co.uk/> each week I have seen this result consistenly for about >> a month. >> >> David >> >> >> >> On 7 March 2017 at 09:03, Carsten Book <cb...@mozilla.com <mailto: >> cb...@mozilla.com>> wrote: >> >> Hi Lawrence, >> >> most (i would say 95 %) of the backouts are for Code issues - this >> include bustages and test failures. >> >> From this Code Issues i would guess its about 2/3 for breaking >> tests and 1/3 Build Bustages. >> >> The other backout reasons are merge conflicts / backout requests for >> changes causes new regressions out of our test suites / backout >> requests from developers etc - >> >> In February the backout rate was (excluding the servo merge with >> 8315 changesets from the 13242) = 297 in 4927 changesets = ~ 6 % >> In January the backout rate = 302 backouts in 4121 changesets = 7 % >> >> We had a much higher backout rate in the past i think - so it >> stabilized now with this 6-7 % backout rate in the last months, >> >> If you think its useful, i can provide for the next monthly report a >> more detailed analysis like x % = backouts because builds bustages, >> y %= backouts for test failures etc . >> >> Cheers, >> -Tomcat >> >> >> On Mon, Mar 6, 2017 at 11:13 PM, Lawrence Mandel >> <lman...@mozilla.com <mailto:lman...@mozilla.com>> wrote: >> >> Hi Tomcat, >> >> Do you have any more details about the reasons why the 297 >> changesets needed to be backed out? >> >> Thanks, >> >> Lawrence >> >> On Wed, Mar 1, 2017 at 6:05 AM, Carsten Book <cb...@mozilla.com >> <mailto:cb...@mozilla.com>> wrote: >> >> Hi, >> >> We will be more active in 2017 and inform more about whats >> happening in Sheriffing and since its already March.... :) >> >> In February we had about 13242 changesets landed on >> mozilla-central monitored by Sheriffs. >> >> (The high number of changes is because of the merge from >> servo to mozilla-central with about 8315 changesets). >> >> 297 changesets were backed out in February. >> >> Beside this Sheriffs took park in doing uplifts and >> checkin-needed bugs. >> >> The Current Orangefactor is 10.43 (7250 test failures >> failures in 695 pushes in the last 7 days). >> You can find the list of top Intermittent failure bugs here >> https://brasstacks.mozilla.com/orangefactor/ >> <https://brasstacks.mozilla.com/orangefactor/> >> >> You can find more statistics here: >> https://futurama.theautomatedtester.co.uk/ >> <https://futurama.theautomatedtester.co.uk/> >> >> A big thanks to the Team especially our Community Sheriffs >> for handling the new Tier 2 Stylo Build on integration >> trees and mozilla-central and the teamwork with the >> Developers! >> >> If you want also to be a Community Sheriffs, as part of more >> blogging about Sheriffing i published a blog post about it : >> https://blog.mozilla.org/tomcat/2017/02/27/community-sheriff >> s/ >> <https://blog.mozilla.org/tomcat/2017/02/27/community-sherif >> fs/> >> >> Let us know when you have any Question or Feedback about >> Sheriffing. >> >> Cheers, >> -Tomcat >> >> >> >> >> >> >> _______________________________________________ >> Sheriffs mailing list >> sheri...@mozilla.org >> https://mail.mozilla.org/listinfo/sheriffs >> >> _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform