The Eideticker project (http://eideticker.mozilla.org) was started
almost 4 years ago, in an effort to better measure the performance of
Firefox for Android by directly capturing video of the browser
performing various actions. It later evolved to encompass testing
FirefoxOS performance. It's an interesting approach and has produced
useful results, especially during a period in 2012-2013 when we were
tuning Firefox for Android to reduce checkerboarding and start up time.
However, it hasn't received much maintenance over the last year, and
some parts of the code (especially those to do with bisection and
backfilling, which are critical to a useful performance harness) have
bitrotted and no longer work. People have (correctly) criticized the set
of tests that we run for lacking relevance: the content we use is old
and sometimes esoteric and the Galaxy Nexus hardware we use is seriously
out of date at this point. For these and other reasons, it's been over a
year since a regression has been filed based on Eideticker data that has
subsequently been addressed.
Given enough time and resources, these issues could be fixed, but we
just don't have them right now. My own attention has shifted to working
on Perfherder and Talos, which has a much larger scope and impact in
terms of the products we ship. We've made a fair bit of progress in this
project over the last couple of quarters (see the recent announcement on
48-hour backouts), but for that to continue it needs more of my attention.
Thus, I'd like to thus propose that we shut this system off for now. It
goes without saying that the code
(https://github.com/mozilla/eideticker) will live on, if we find out
that we want to reactivate the project at some future point that should
be totally possible.
Will
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform
