Hello everyone,

We've reached a milestone in our Raptor to Browsertime migration!

As of last Friday, we no longer run Raptor pageload tests on the Fenix
repository - these have all been replaced with their Browsertime variants
<https://treeherder.mozilla.org/#/jobs?repo=fenix&searchStr=tp6&fromchange=9e324fa02a6c3811165707e4210fa5a9c1690fda>.
We now have visual metrics running on all the Fenix cold pageload tests as
well. The PR for those changes can be found here
<https://github.com/mozilla-mobile/fenix/pull/9402>.

We also landed the first piece of work that lets us run Google Chrome for
Android tests in CI using browsertime. At the moment, we are only running
Amazon and YouTube cold pageload tests for this browser (with visual
metrics), but this will be expanded to pageload testing live sites in the
next month. You can follow this Jira ticket
<https://jira.mozilla.com/browse/FXP-546>, or this bug
<https://bugzilla.mozilla.org/show_bug.cgi?id=1625470> for that work.

The visual metrics we are collecting on Fenix and Chrome include:

   - SpeedIndex
   <https://www.sitespeed.io/documentation/sitespeed.io/metrics/#speed-index>
   - ContentfulSpeedIndex
   
<https://www.sitespeed.io/documentation/sitespeed.io/metrics/#contentful-speed-index>
   - PerceptualSpeedIndex
   
<http://www.parvez-ahammad.org/blog/perceptual-speed-index-psi-for-measuring-above-fold-visual-performance-of-webpages>
      - Similar to SpeedIndex, but it uses structural similarity.
      - FirstVisualChange
   
<https://www.sitespeed.io/documentation/sitespeed.io/metrics/#first-visual-change>
   - LastVisualChange
   
<https://www.sitespeed.io/documentation/sitespeed.io/metrics/#last-visual-change>


Thanks,
Greg
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Reply via email to