> If there are issues on that platform, no further platforms are scheduled.

How do you define "issues"?  Does "issues" mean "any orange"?  At the
moment, determining the difference between intermittent and
perma-orange must be done by a human.  We have no algorithms for doing
so automatically.

This may be a good idea, but I just mean to point out that getting it
right is non-trivial with our current tools, and in particular, that
differentiating between "real" and "intermittent" oranges is probably
the hardest part of this scheme.


I think adding |-p any| plus explicit acknowledging that a green -p
any build is sufficient testing to push non-platform-specific patches
to m-i could have a positive impact on our resource usage without
causing devs or sheriffs too much pain.  The reduced load might let us
coalesce fewer builds on m-i, and the improved turnaround speed of
pushing to try with -p any might make more people do it, reducing
all-platform m-i orange/reds.

On Fri, Sep 28, 2012 at 3:44 PM, Ehsan Akhgari <ehsan.akhg...@gmail.com> wrote:
> On 2012-09-28 1:37 PM, Seth Fowler wrote:
>>
>> I am new to the use of the try build system and so this is not a
>> suggestion informed
>> by much experience with this particular setup, but time spent in other
>> environments
>> has shown me that running these sorts of test builds on all platforms can
>> sometimes be quite useful.
>>
>> I'd suggest a variation on this idea: all-platform try builds should
>> automatically be
>> scheduled to only one platform initially, that with the fastest turnaround
>> and lowest
>> load. If there are issues on that platform, no further platforms are
>> scheduled.
>> If that platform is all green, the remaining platforms are scheduled in
>> parallel as
>> happens now.
>>
>> This seems to me to offer the best of all possible worlds: we fail early
>> in the
>> case where there are problems, but we also do our best to flush out issues
>> that may not have been caught on the initially chosen platform.
>
>
> This is a great idea, and we have in fact discussed this in the past.  I
> think it makes sense for us to do this, and -p any is definitely a good
> first step.
>
> Cheers,
> Ehsan
>
>
> _______________________________________________
> dev-platform mailing list
> dev-platform@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-platform
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Reply via email to