George,

(with reduction of load to normal levels),

Probably it's not the best idea just to run samples, they are called
samples for the reason  ;)

Basically you can run same Rally task two times before/after upgrade and
compare results (Rally has sort of trends support)
Usually what I have heard from Ops guys is next:

   - Run Rally on periodic basis
   - Convert data Rally DB -> ElasticSearch
   - Build Kibana/Grafana on top


FYI I am working on making above scenario work out of the box.

-- 

So can you provide some more details on what you are looking for? What's
missing?


Best regards,
Boris Pavlovic

On Tue, Aug 29, 2017 at 2:24 AM, George Shuklin <george.shuk...@gmail.com>
wrote:

> Hello everyone.
>
> Does someone do regression testing before performing upgrade (within same
> major version)? How do you do this? Do you know any tools for such tests? I
> started to research this area, and I see three openstack-specific tools:
> rally (with reduction of load to normal levels), tempest (can it be used by
> operators?) and granade.
>
> If you use any of tools, how do you feel about them? Are they worth time
> spent?
>
>
> Thanks!
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
_______________________________________________
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

Reply via email to