On 07/03/2014 02:41 PM, Fawad Khaliq wrote:
On Thu, Jul 3, 2014 at 10:27 AM, Kevin Benton <[email protected] <mailto:[email protected]>> wrote: >This allows the viewer to see categories of reviews based upon their >divergence from OpenStack's Jenkins results. I think evaluating >divergence from Jenkins might be a metric worth consideration. I think the only thing this really reflects though is how much the third party CI system is mirroring Jenkins. A system that frequently diverges may be functioning perfectly fine and just has a vastly different code path that it is integration testing so it is legitimately detecting failures the OpenStack CI cannot. Exactly. +1
Unfortunately, there's no good way to prove that. -jay _______________________________________________ OpenStack-dev mailing list [email protected] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
