Re: what is new in talos, what is coming up

It has been a while since we posted an update on Talos Here are some new things: * bug 1166132 - new tps test - tab switching * e10s on all platforms, only runs on mozilla-central for pgo builds, broken tests, big regressions are tracked in bug 1144120 * perfherder is easier to use, some polish o

Re: what is new in talos, what is coming up

> > >> can we keep the > >> snarkfest version running please until this is resolved? > > My main concern was because I inferred from the previous post that > deprecation of snarkfest was scheduled on a timeline basis. > > Can we instead schedule on a when-its-ready basis, please? > yes- we ar

Re: what is new in talos, what is coming up

William Lachance writes: > Hi Karl, > > On 2015-06-04 12:30 AM, Karl Tomlinson wrote: >> jma...@mozilla.com writes: >> >>> >We will deprecate those instances of compare-talos next quarter >>> >completely. >> The treeherder version seems to randomly choose which and how many >> of the results to

Re: what is new in talos, what is coming up

Hi Karl, On 2015-06-04 12:30 AM, Karl Tomlinson wrote: jma...@mozilla.com writes: >2) compare-talos is in perfherder >(https://treeherder.mozilla.org/perf.html#/comparechooser), other instances of >compare-talos have a warning message at the top indicating you should use >perfherder. We will

Re: what is new in talos, what is coming up

Thanks, Joel. I've benefited from being able to use perf.html#/comparechooser and will look forward to the performance discussion. jma...@mozilla.com writes: > 2) compare-talos is in perfherder > (https://treeherder.mozilla.org/perf.html#/comparechooser), other instances of > compare-talos have

Re: what is new in talos, what is coming up

Things are still changing with Talos- many things are becoming easier, while others still have kinks to work out- here are a few things which have changed recently: 1) Android talos has been reduced to what is useful- it should run faster and sets us up for migrating to autophone next quarter 2

Re: what is new in talos, what is coming up

Great question Brian! I believe you are asking if we would generate alerts based on individual tests instead of the summary of tests. The short answer is no. In looking at reporting the subtest results as new alerts, we found there was a lot of noise (especially in svgx, tp5o, dromaeo, v8) as co

Re: what is new in talos, what is coming up

The upcoming changes sound great! Is there currently a way (or plans to add a way) to track regressions / improvements for a single measurement within a test? I see that in perfherder I can add these measurements to a graph (http://mzl.la/1E17Zyo ) but it’s hard to disti

what is new in talos, what is coming up

It is always hard to advertise every change, but there are enough changes to post a brief summary. What has changed: 1) :bgrins has added a new talos test 'damp' - devtools at maximum performance! This was done in https://bugzilla.mozilla.org/show_bug.cgi?id=1150215 2) Talos doesn't run on OSX