Re: [openstack-dev] [tempest][nova][defcore] Add option to disable some strict response checking for interop testing

2016-06-15 Thread Daryl Walleck
> -Original Message- > From: GHANSHYAM MANN [mailto:ghanshyamm...@gmail.com] > Sent: Wednesday, June 15, 2016 9:59 PM > To: OpenStack Development Mailing List (not for usage questions) > > Subject: Re: [openstack-dev] [tempest][nova][defcore] Add option to > disable some strict response c

Re: [openstack-dev] [QA][all] Propose to remove negative tests from Tempest

2016-03-18 Thread Daryl Walleck
I do think negative tests should live on, most likely in their own tempest-plugin based repository. However, I'm not sure that I agree with the reason being because they are functional tests rather than integration. If you look at the current tests, one could argue that many non-Nova tests are

[openstack-dev] [qa] [tempest] Question on time precision in auth providers

2015-05-03 Thread Daryl Walleck
Hi folks, While running Tempest I ran into a bit of interesting behavior. As part of the Tempest auth client, checks are performed to assure the token in use is still valid. When parsing the expiry timestamp from the auth response, a very specific datetime format is expected for Keystone v2 a

Re: [openstack-dev] [QA] Questions about test policy for scenario test

2014-06-25 Thread Daryl Walleck
I really like this option, especially if it leaves a generic hook available for validation. This could allow for different types of compute validators such as hypervisor specific or 3rd party compute validators to be implemented. From: Fei Long Wang mailto:feil...@catalyst.net.nz>> Reply-To: "Op

Re: [openstack-dev] [qa] Smarter timeouts in Tempest?

2014-05-19 Thread Daryl Walleck
This is still a partially formed idea, but one of the ways I've thought of solving the timeout issue is by using aggregate data from previous results. Any of the event systems (Ceilometer, StackTach) should allow you to create models of what an inbounds server build (or any action) time per imag

Re: [openstack-dev] [qa] Selecting Compute tests by driver/hypervisor

2014-04-22 Thread Daryl Walleck
22, 2014 5:40 AM To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [qa] Selecting Compute tests by driver/hypervisor On 04/21/2014 06:52 PM, Daryl Walleck wrote: > I nearly opened a spec for this, but I’d really like to get some > feedback first. One of the challenges I’ve seen late

[openstack-dev] [qa] Selecting Compute tests by driver/hypervisor

2014-04-21 Thread Daryl Walleck
I nearly opened a spec for this, but I'd really like to get some feedback first. One of the challenges I've seen lately for Nova teams not using KVM or Xen (Ironic and LXC are just a few) is how to properly run the subset of Compute tests that will run for their hypervisor or driver. Regexes are

Re: [openstack-dev] [qa] [ironic] Need tempest reviews from ironic team

2014-03-31 Thread Daryl Walleck
Hi David, I'm actually starting to ramp up on Ironic, so once I have my dev environment up and running, I'll be more than glad to have a look at any Tempest/Ironic reviews. Daryl From: David Kranz [dkr...@redhat.com] Sent: Monday, March 31, 2014 3:46 PM To: open

Re: [openstack-dev] [Ironic] Functional testing, Tempest

2014-03-23 Thread Daryl Walleck
Hi Adam, I think the steps you've completed so far are the foundation for testers like myself to be able to really dive in and start kicking the tires of Ironic. Having an easily repeatable way to generate test environments makes a huge impact in where I spend my time (environments vs actual te