Re: Proposal for informing Developers and Sheriffs about new Testsuites

2017-06-14 Thread Nicholas Alexander
On Wed, Jun 14, 2017 at 1:58 AM, Carsten Book wrote: > Hi, > > we had the case that a new testsuite was enabled and one test of that > suite resulted in a new perma orange failure. Its a tier-2 testsuite but of > course also tier 2 cause additional work for sheriffs. > > The Problem on new Testsu

Re: Proposal for informing Developers and Sheriffs about new Testsuites

2017-06-14 Thread bdahl
On Wednesday, June 14, 2017 at 1:58:39 AM UTC-7, Carsten Book wrote: > Hi, > > we had the case that a new testsuite was enabled and one test of that suite > resulted in a new perma orange failure. Its a tier-2 testsuite but of > course also tier 2 cause additional work for sheriffs. > > The Probl

Re: [Sheriffs] Proposal for informing Developers and Sheriffs about new Testsuites

2017-06-14 Thread Justin Wood
Or if you must enable it in tree for try ahead of it being ready, enable it as *tier 3* that way, those of you who *do* care can look at results, while the rest of the dev audience can be ignorant to it, and happily so. (Some reasons for enable in tree ahead of ready, could be to help keep co

Re: Proposal for informing Developers and Sheriffs about new Testsuites

2017-06-14 Thread Bill McCloskey
Related to this, I would like to ask that people not enabled test suites on try if they're orange. I've wasted a lot of time myself trying to understand failures that were not my fault, and I know other people have too. Since new tests suites are presumably being enabled through TaskCluster and do

Re: Proposal for informing Developers and Sheriffs about new Testsuites

2017-06-14 Thread William Lachance
Isn't this the sort of thing m.d.tree-management is for? I would say that + sheriffs@ should be enough. Will On 2017-06-14 10:37 AM, Carsten Book wrote: i guess sheriffs list (sheriffs @ m.o ) and newsgroup dev.platform, fx -dev but i'm also open for suggetions from others :) - tomcat On Wed

Re: Proposal for informing Developers and Sheriffs about new Testsuites

2017-06-14 Thread Carsten Book
i guess sheriffs list (sheriffs @ m.o ) and newsgroup dev.platform, fx -dev but i'm also open for suggetions from others :) - tomcat On Wed, Jun 14, 2017 at 4:12 PM, Kartikaya Gupta wrote: > This sounds good to me. What mailing lists should the intent email be > sent to? It might help to have a

Re: Proposal for informing Developers and Sheriffs about new Testsuites

2017-06-14 Thread Kartikaya Gupta
This sounds good to me. What mailing lists should the intent email be sent to? It might help to have a template somewhere as well. On Wed, Jun 14, 2017 at 4:58 AM, Carsten Book wrote: > Hi, > > we had the case that a new testsuite was enabled and one test of that suite > resulted in a new perma o

Proposal for informing Developers and Sheriffs about new Testsuites

2017-06-14 Thread Carsten Book
Hi, we had the case that a new testsuite was enabled and one test of that suite resulted in a new perma orange failure. Its a tier-2 testsuite but of course also tier 2 cause additional work for sheriffs. The Problem on new Testsuite is that Sheriffs are in a lot of cases not informed about that