## Summary of the past month
Coverage is enabled for nearly all tests, and scheduled every night [1]!!
* All c/c++ test suites have coverage enabled and are running nightly
* jsvm[7] coverage is enabled, and running
* codecov.io [2] shows the results, broken down by directory
## Complications
* Rust code coverage is still delayed [6]
* There is instability in the coverage numbers due to variability in
our test runs. This is minor compared to the large volume of
coverage we are collecting, but it may impact discriminating analysis.
## Plans for remaining Quarter
* Release management requires a view into how coverage is changing
over time, and relate that change to changesets and bugs.
mcastelluccio has a very rough prototype [10]
* Work on the long tail of test suite flavors, esoteric tests,
intermittent tests, skipped tests, and operational details to keep
this whole thing running smooth [9]
* Streamline the grcov ETL pipeline
* Explore what else we can do with this data.
* Put together a presentation deck, just in case someone is
interested, for AllHands.
## Meetings
We have weekly CodeCoverage meetings, and you are welcome to attend:
* When: Held every Friday @ 11:30 EDT (08:30 PDT)
* Where: Kyle's video room
https://v.mozilla.com/flex.html?roomdirect.html&key=huhL8WaTwCwC
* Etherpad: https://public.etherpad-mozilla.org/p/code_coverage_Q1_17
## Reference
[1] See coverage on TH
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&filter-searchStr=ccov
[1b] Example on TH:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=e61060be36424240058f8bef4c5597f401bc8b7e&filter-searchStr=ccov
[2] codecov.io https://codecov.io/gh/marco-c/gecko-dev
[3] Local Coverage
https://developer.mozilla.org/en-US/docs/Mozilla/Testing/Measuring_Code_Coverage_on_Firefox?document_saved=true#Generate_Code_Coverage_report_from_a_try_build_(or_any_other_treeherder_build
<https://developer.mozilla.org/en-US/docs/Mozilla/Testing/Measuring_Code_Coverage_on_Firefox?document_saved=true#Generate_Code_Coverage_report_from_a_try_build_%28or_any_other_treeherder_build>)
[4] iOS Coverage
https://codecov.io/gh/mozilla-mobile/firefox-ios/branch/master
[5] User Cases
https://docs.google.com/document/d/1JUEPS8Xdtx4y8fXA4Au_Ggme0fMyJQxZbby0X2e4yDI/edit#heading=h.ddwyjkvxus4-
[6] Rust coverage
https://docs.google.com/document/d/1JUEPS8Xdtx4y8fXA4Au_Ggme0fMyJQxZbby0X2e4yDI/edit#heading=h.ddwyjkvxus4
[7] JSVM coverage: https://bugzilla.mozilla.org/show_bug.cgi?id=1301174
[8] e10s coverage example:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=b6e9cefe95adc3dd281bf8e2a2f897e8f4839e51
[9] Everything:
https://bugzilla.mozilla.org/showdependencytree.cgi?id=1278393
[10] Show coverage differences, with bug numbers:
https://marco-c.github.io/grcov-test/coverage_by_dir.html
_______________________________________________
dev-platform mailing list
[email protected]
https://lists.mozilla.org/listinfo/dev-platform
