Re: [Openstack-qa-team] Tempest Gating

2012-09-10 Thread James E. Blair
Jay Pipes writes: > On 09/07/2012 08:13 PM, Dan Smith wrote: >> >> Running tempest tests in parallel is definitely a good goal to >> have. However, I believe that all the tests run in a gate are done >> sequentially right now, correct? Seems like if we kicked off tempest at >> the same time as t

Re: [Openstack-qa-team] Tempest Gating

2012-09-05 Thread James E. Blair
Hi, In last weeks QA meeting, there was some talk about making improvements around devstack-gate and tempest. As I understand it, one of the problems is that things are changing in other projects that are causing tests in the full (non-smoke) tempest suite to fail, which prevents changes being me

Re: [Openstack-qa-team] Tempest Gating

2012-08-22 Thread James E. Blair
David Kranz writes: > Thanks, Jim. It seems that the tests are passing after the submission > to skip some tests. That still leaves the problem of figuring out what > the problems are. I want to file a bug about the fact that there are > backtraces in the n-cpu log even on a "successful" build. I

Re: [Openstack-qa-team] Tempest Gating

2012-08-22 Thread James E. Blair
Dan Smith writes: > I just verified this by looking at the zuul queue link you provided. I > see in the check queue things in the following order: > > 11411, 11500, 11823, 11754, 11440, 11351, 11353, 11482 Oh, I thought you were talking about gating; the check pipeline tests patches independentl

Re: [Openstack-qa-team] Tempest Gating

2012-08-22 Thread James E. Blair
Dan Smith writes: > One thing I noticed while doing some of this was that Jenkins doesn't > seem to know about dependent patches, and will often run them in some > sub-optimal order. This means that if the third patch in a series of ten > is broken, it still runs everything ten times, instead of

Re: [Openstack-qa-team] Tempest Gating

2012-08-22 Thread James E. Blair
David Kranz writes: > I just submitted https://review.openstack.org/#/c/11755/ to skip the > tests that are failing. I filed three bug tickets too. I can only > reproduce one of them in my environment (the one where the error code > seems to have changed). BTW, I looked at the nova logs for a tem

Re: [Openstack-qa-team] Viewing Devstack environment Logs for Tempest jobs

2012-08-02 Thread James E. Blair
"Karajgi, Rohit" writes: > Hi, > > I was interested to know if there is any way to see the OpenStack > service logs (not the Build console logs) that the Tempest gate jobs > run against? I have faced a couple of situations in which the > gate-tempest-devstack-vm job fails but I was unable to rep