(2014/04/17 4:22), Jaume Devesa wrote:
I thought that OpenStack just support one release backwards, if we have
to support three versions, this is not useful.

In fact, I could not make sense this meaning. OpenStack has two "security-supported" series and one project under development.
https://wiki.openstack.org/wiki/Releases

Therefore, I think Sean's proposal is reasonable. Tempest should be able to test two supported releases for administrators and one release for developers.


There are already ways to enable/disable modules in tempest to adapt to
each deployment needs. Just wanted to avoid more configuration options.




On 16 April 2014 21:14, David Kranz <dkr...@redhat.com
<mailto:dkr...@redhat.com>> wrote:

    On 04/16/2014 11:48 AM, Jaume Devesa wrote:
    Hi Sean,

    for what I understood, we will need a new feature flag for each
    new feature, and a feature flag (default to false) for each
    deprecated one. My concern is: since the goal is make tempest a
    confident tool to test any installation and not and 'tempest.conf'
    will not be auto-generated from any tool as devstack does,
    wouldn't be too hard to prepare a tempest.conf file with so many
    feature flags to enable and disable?
    If we go down this route, and I think we should, we probably need to
    accept that it will be hard for users to manually configure
    tempest.conf. Tempest configuration would have to be done by
    whatever installation technology was used, as devstack does, or by
    auto-discovery. That implies that the presence of new features
    should be discoverable through the api which is a good idea anyway.
    Of course some one could configure it manually but IMO that is not
    desirable even with where we are now.


    Maybe I am simplifying too much, but wouldn't be enough with a
    pair of functions decorators like

    @new
    @deprecated

    Then, in tempest.conf it could be a flag to say which OpenStack
    installation are you testing:

    installation = [icehouse|juno]

    if you choose Juno, tests with @new decorator will be executed and
    tests with @deprecated will be skipped.
    If you choose Icehouse, tests with @new decorator will be skipped,
    and tests with @deprecated will be executed

    I am missing some obvious case that make this approach a nonsense?
    There are two problems with this. First, some folks are chasing
    master for their deployments and some do not deploy all the features
    that are set up by devstack. In both cases, it is not possible to
    identify what can be tested with a simple name that corresponds to a
    stable release. Second, what happens when we move on to K? The
    meaning of "new" would have to change while retaining its old
    meaning as well which won't work. I think Sean spelled out the
    important scenarios.

      -David


    Regards,
    jaume


    On 14 April 2014 15:21, Sean Dague <s...@dague.net
    <mailto:s...@dague.net>> wrote:

        As we're coming up on the stable/icehouse release the QA team
        is looking
        pretty positive at no longer branching Tempest. The QA Spec
        draft for
        this is here -
        
http://docs-draft.openstack.org/77/86577/2/check/gate-qa-specs-docs/3f84796/doc/build/html/specs/branchless-tempest.html
        and hopefully address a lot of the questions we've seen so far.

        Additional comments are welcome on the review -
        https://review.openstack.org/#/c/86577/
        or as responses on this ML thread.

                -Sean

        --
        Sean Dague
        Samsung Research America
        s...@dague.net <mailto:s...@dague.net> /
        sean.da...@samsung.com <mailto:sean.da...@samsung.com>
        http://dague.net


        _______________________________________________
        OpenStack-dev mailing list
        OpenStack-dev@lists.openstack.org
        <mailto:OpenStack-dev@lists.openstack.org>
        http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




    _______________________________________________
    OpenStack-dev mailing list
    OpenStack-dev@lists.openstack.org  
<mailto:OpenStack-dev@lists.openstack.org>
    http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


    _______________________________________________
    OpenStack-dev mailing list
    OpenStack-dev@lists.openstack.org
    <mailto:OpenStack-dev@lists.openstack.org>
    http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




_______________________________________________
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


--
Daisuke Morita <morita.dais...@lab.ntt.co.jp>
NTT Software Innovation Center, NTT Corporation


_______________________________________________
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Reply via email to