On Thu, Jun 19, 2014 at 11:52 PM, Paul Larson <paul.lar...@canonical.com> wrote: > We'll soon be landing the health-check tests from Colin King in the CI daily > smoke runs for Ubuntu Touch. These tests will trace processes running on the > device and provide stats on things like cpu, wakeup events, and I/O > operations. These are then compared against baseline thresholds to provide > pass/fail results. I've been iterating on this for quite a while with a > stable image, and Colin has been tweaking the thresholds, but we do expect > there to be some failures at first at least. These will need to be > individually analyzed. So the reason for the notice here, is because you > should soon start to see ~30 new tests show up in the dash board, some of > which may fail at first. Until things stabilize, these are new tests so they > probably shouldn't be treated as a regression.
That's amazing. Really looking forward to see those goodies on the dashboard. I am not sure how easy they will be to read/interpret, but maybe it would make sense if you and Colin offer 1 or 2 calls explaining what we see there and how to interpret those results? Anyway, maybe lets check once we see the actual dashboard entries. > > The other thing to be aware of is that they can take a very long time to > run. In order to get an accurate picture of what the process is doing over > time, each process needs to be monitored for at least 5 minutes. Total run > time is usually 2-4 hours for just this test suite. In order to minimize > the impact, these will be separate runs that take place after the normal > smoke tests, but the results should feed into the same dashboard so that > they are more visible. This way, the long running health check job should > not impact getting our regular smoke results in a timely fashion. Sounds perfect to run them independent if they feed into the same dashboard view! Thanks! > > -- > Mailing list: https://launchpad.net/~ubuntu-phone > Post to : ubuntu-phone@lists.launchpad.net > Unsubscribe : https://launchpad.net/~ubuntu-phone > More help : https://help.launchpad.net/ListHelp > -- Mailing list: https://launchpad.net/~ubuntu-phone Post to : ubuntu-phone@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-phone More help : https://help.launchpad.net/ListHelp
