Hi!

In the QA meeting yesterday, we decide to create a blueprint specific for the negative tests in a separate file: https://blueprints.launchpad.net/tempest/+spec/negative-test-files and use it to track the patches.

I added the etherpad link Ken'ichi pointed to this bp. Ken'ichi, should you be the owner of this bp?

Giulio, could you mark it  In Progress?

Regards,

Adalberto Medeiros
Linux Technology Center
Openstack and Cloud Development
IBM Brazil
Email: adal...@linux.vnet.ibm.com

On Mon 02 Dec 2013 10:23:07 PM BRST, Christopher Yeoh wrote:

On Tue, Dec 3, 2013 at 9:43 AM, Kenichi Oomichi
<oomi...@mxs.nes.nec.co.jp <mailto:oomi...@mxs.nes.nec.co.jp>> wrote:


    Hi Sean, David, Marc

    I have one question about negative tests.
    Now we are in moratorium on new negative tests in Tempest:
    http://lists.openstack.org/pipermail/openstack-dev/2013-November/018748.html

    Is it OK to consider this kind of patch(separating negative tests from
    positive test file, without any additional negative tests) as an
    exception?


I don't have a strong opinion on this, but I think it's ok given it
will make the eventual removal of
hand coded negative tests in the future easier even though it costs us
a bit of churn now.

Chris


    Thanks
    Ken'ichi Ohmichi

    ---

    > -----Original Message-----
    > From: Adalberto Medeiros [mailto:adal...@linux.vnet.ibm.com
    <mailto:adal...@linux.vnet.ibm.com>]
    > Sent: Monday, December 02, 2013 8:33 PM
    > To: OpenStack Development Mailing List (not for usage questions)
    > Subject: Re: [openstack-dev] [tempest] list of negative tests
    that need to be separated from other tests.
    >
    > Thanks Ken'ichi. I added my name to a couple of them in that list.
    >
    > Adalberto Medeiros
    > Linux Technology Center
    > Openstack and Cloud Development
    > IBM Brazil
    > Email: adal...@linux.vnet.ibm.com
    <mailto:adal...@linux.vnet.ibm.com>
    >
    > On Mon 02 Dec 2013 07:36:38 AM BRST, Kenichi Oomichi wrote:
    > >
    > > Hi Adalberto,
    > >
    > >> -----Original Message-----
    > >> From: Adalberto Medeiros [mailto:adal...@linux.vnet.ibm.com
    <mailto:adal...@linux.vnet.ibm.com>]
    > >> Sent: Saturday, November 30, 2013 11:29 PM
    > >> To: OpenStack Development Mailing List
    > >> Subject: [openstack-dev] [tempest] list of negative tests
    that need to be separated from other tests.
    > >>
    > >> Hi!
    > >>
    > >> I understand that one action toward negative tests, even before
    > >> implementing the automatic schema generation, is to move them
    to their
    > >> own file (.py), thus separating them from the 'positive'
    tests. (See
    > >> patch https://review.openstack.org/#/c/56807/ as an example).
    > >>
    > >> In order to do so, I've got a list of testcases that still
    have both
    > >> negative and positive tests together, and listed them in the
    following
    > >> etherpad link:
    https://etherpad.openstack.org/p/bp_negative_tests_list
    > >>
    > >> The idea here is to have patches for each file until we get
    all the
    > >> negative tests in their own files. I also linked the etherpad
    to the
    > >> specific blueprint created by Marc for negative tests in icehouse
    > >> (https://blueprints.launchpad.net/tempest/+spec/negative-tests ).
    > >>
    > >> Please, send any comments and whether you think this is the right
    > >> approach to keep track on that task.
    > >
    > > We have already the same etherpad, and we are working on it.
    > > Please check the following:
    > > https://etherpad.openstack.org/p/TempestTestDevelopment
    > >
    > >
    > > Thanks
    > > Ken'ichi Ohmichi
    > >
    > >
    > > _______________________________________________
    > > OpenStack-dev mailing list
    > > OpenStack-dev@lists.openstack.org
    <mailto:OpenStack-dev@lists.openstack.org>
    > > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
    > >
    >
    >
    > _______________________________________________
    > OpenStack-dev mailing list
    > OpenStack-dev@lists.openstack.org
    <mailto:OpenStack-dev@lists.openstack.org>
    > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

    _______________________________________________
    OpenStack-dev mailing list
    OpenStack-dev@lists.openstack.org
    <mailto:OpenStack-dev@lists.openstack.org>
    http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




_______________________________________________
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


_______________________________________________
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Reply via email to