On 12/09/17 14:55, Andrew Halberstadt wrote:
On Mon, Sep 11, 2017 at 10:33 PM Robert O'Callahan <rob...@ocallahan.org>
wrote:
On Tue, Sep 12, 2017 at 11:38 AM, Andrew Halberstadt <
ahalberst...@mozilla.com> wrote:
I don't think so, that data already exists and is query-able from
ActiveData:
https://activedata.allizom.org/tools/query.html#query_id=8pDOpeni
That query tells you about disabled tests, but doesn't know about *why* a
test was disabled. E.g. you can't distinguish tests disabled because
they're not expected to work on some (or all) platforms from tests that
were disabled for intermittent failures that should, in principle, be fixed.
Rob
True, though I don't know that gps' proposal would solve that either.
But this is a good idea, and is easy to solve from a technical standpoint.
We'd just need to agree on some standard manifest keys:
I'm pretty sure that the problem isn't technical, but actually getting
people to do that consistently (plus retrofitting the data onto
thousands of currently disabled tests). You would at least have to add a
lint and a free pass for all the existing tests.
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform
