I filed bug 1149670 for the mach try feature. On Tue, Mar 31, 2015 at 10:39 AM, Andrew Halberstadt < [email protected]> wrote:
> It's technically already possible by modifying the in-tree mozharness > configs here: > https://dxr.mozilla.org/mozilla-central/source/testing/config/mozharness > > However it's not easy to figure out what needs to be modified to get the > desired results. Some sort of |mach try| like command is going to be worked > on in Q2 to make pushing various test configurations to try easier, I'm not > 100% sure how it will be implemented yet though. > > In the meantime, if you get stuck trying to modify the mozharness configs, > let me know and I can come up with an example patch. > > -Andrew > > > On 31/03/15 01:06 PM, Bobby Holley wrote: > >> This sounds awesome! Is there an estimate of when we'll be able to use it >> for try pushes? >> >> On Tue, Mar 31, 2015 at 9:30 AM, Andrew Halberstadt < >> [email protected] <mailto:[email protected]>> wrote: >> >> As of bug 987360, you can now run all tests with a given tag for >> mochitest (and variants), xpcshell and marionette based harnesses. >> Tags can be applied to either individual tests, or the DEFAULT >> section in manifests. Tests can have multiple tags, in which case >> they should be comma delimited. To run all tests with a given tag, >> pass in --tag <tag name> to the mach command. >> >> For example, let's say we want to group all mochitest-plain tests >> related to canvas together. First we'd add a 'canvas' tag to the >> DEFAULT section in >> https://dxr.mozilla.org/mozilla-central/source/dom/ >> canvas/test/mochitest.ini >> >> [DEFAULT] >> tags = canvas >> >> We notice there is also a canvas related test under dom/media, namely: >> https://dxr.mozilla.org/mozilla-central/source/dom/ >> media/test/mochitest.ini#541 >> >> Let's pretend it is already tagged with the 'media' tag, but >> that's ok, we can add a second tag no problem: >> >> [test_video_to_canvas.html] >> tags = media,canvas >> >> Repeat above for any other tests or manifests scattered in the >> tree that are related to canvas. Now we can run all >> mochitest-plain tests with: >> >> ./mach mochitest-plain --tag canvas >> >> You can also run the union of two tags by specifying --tag more >> than once (though the intersection of two tags is not supported): >> >> ./mach mochitest-plain --tag canvas --tag media >> >> So far the xpcshell (./mach xpcshell-test --tag name) and >> marionette (./mach marionette-test --tag name) commands are also >> supported. Reftest is not supported as it has its own special >> manifest format. >> >> Applying tags to tests will not affect automation or other >> people's tags. So each organization or team should feel free to >> use tags in whatever creative ways they see fit. Eventually, we'll >> start using tags as a foundation for some more advanced features >> and analysis. For example, we may implement a way to run all tests >> with a given tag across multiple different suites. >> >> If you have any questions or things aren't working, please let me >> know! >> >> Cheers, >> Andrew >> _______________________________________________ >> dev-platform mailing list >> [email protected] <mailto:[email protected] >> > >> https://lists.mozilla.org/listinfo/dev-platform >> >> >> > _______________________________________________ > dev-platform mailing list > [email protected] > https://lists.mozilla.org/listinfo/dev-platform > _______________________________________________ dev-platform mailing list [email protected] https://lists.mozilla.org/listinfo/dev-platform
