For the opened bugs it would be nice to know to focus on ones that have >1 instance, that means that there is a much higher chance to reproduce the bug rather than letting hundreds (or even 1000+) of test runs go by without seeing another instance of the failure.
-Joel On Mon, Sep 28, 2015 at 1:52 PM, Ryan VanderMeulen < rvandermeu...@mozilla.com> wrote: > Included auto-closed bugs in that count sounds misleading at best. > > On Mon, Sep 28, 2015 at 1:52 PM, Wes Kocher <wkoc...@mozilla.com> wrote: > >> What if the query was changed to only count bugs resolved 'fixed'? I >> believe all of the inactive intermittent bugs get closed as worksforme or >> invalid? >> >> On Mon, Sep 28, 2015 at 10:45 AM, Ehsan Akhgari <ehsan.akhg...@gmail.com> >> wrote: >> >>> On 2015-09-28 7:26 AM, Carsten Book wrote: >>> >>>> 3. Statistics >>>> >>>> Intermittent Bugs filed this month [1]: 400 >>>> Intermittent Bugs closed this month [2]: 214 >>>> >>> >>> In the past couple of weekends, I spent some time fixing the worst >>> offenders in intermittent oranges according to OrangeFactor, and the number >>> 214 above was *shocking* to me since almost none of the bugs I looked at >>> had any activity on them. Skimming over http://mzl.la/1PJ287C, it >>> seems that many of these are bugs that were closed because the failures >>> weren't happening before, which makes it confusing to mix that pool with >>> the actual number of bugs that were fixed as a result of a patch landing. >>> >>> Can we somehow improve the statistics here to measure the actual bug >>> fixes? A change as simple as filtering out "nob...@mozilla.org" as the >>> assignee of the bug narrows the list down to 45 bugs, but that is probably >>> inaccurate since the merge tool had not adjusted the assignee of bug 703773 >>> for example. But just filtering based on the assignee seems like a better >>> way to get data closer to reality here. >>> >>> Cheers, >>> Ehsan >>> >> >> > _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
