Thanks PL, I have focussed on a nose2 on python3 implementation so far [1]. If anybody feels like contributing there, be welcome. I is only a PoC yet but looks promising. The total work seems like a moderately large job and pretty straight forward, with the most challenging part the redesign of the callbacks being provided by nose2 in comparison to nose. We still have to test verification through ssh and db connectors but these are so widely used by the larger python community that I'm not too scared of those. I hope that nose2 has a lively community as I see more issues than answers on github [2] serverspec seems like a good model, so I'll give that a look as well
@Peter (peter.murysh...@zv.fraunhofer.de) I saw a separate mail [3] by you about your test setup, but couldn't grasp it yet. I hope we can have a ccc one day soon again to discuss in close quarters. [1] https://github.com/apache/cloudstack/pull/4479 [2] https://github.com/nose-devs/nose2/issues?q=is%3Aissue+is%3Aopen+sort%3Aupdated-desc [3] https://lists.apache.org/thread.html/r0788da5cdbaaaa0cebf349b12cc5f488621c48e509e880216989cb35%40%3Cdev.cloudstack.apache.org%3E On Mon, 16 Nov 2020, 15:03 Pierre-Luc Dion, <pdion...@apache.org> wrote: > It would be interesting if we could come up with a catalogue of api tests, > as serverspec [1] did for infrastructure tests. > if we would have some kind of library of tests, then the only things we > would define in our tests suite would be the order of > unit tests and pretty much no code. > > I don't know if there is an equivalent of serverspec framework on Python, > serverspec is the predecessor to Chef-inspec, unit tests for infra. > This could be a reference starting point. > > Via nose2 seems to make sense. > > [1] https://serverspec.org/ > > > On Mon, Nov 16, 2020 at 5:34 AM <peter.murysh...@zv.fraunhofer.de> wrote: > > > Hi there Dan, > > > > we work to setup the test environment and will share relevant output > > fragments with the limitation we can't share complete logs publicly. > > > > kind regards > > Peter > > ________________________________________ > > Von: Daan Hoogland <daan.hoogl...@gmail.com> > > Gesendet: Montag, 16. November 2020 11:12:55 > > An: dev > > Betreff: Re: [DISCUSS] python test framework > > > > sounds like I am on my own. Any body cares to chime in? > > > > On Thu, Nov 12, 2020 at 10:21 PM Nicolas Vazquez < > > nicolas.vazq...@shapeblue.com> wrote: > > > > > LGTM > > > > > > > > > Regards, > > > > > > Nicolas Vazquez > > > > > > ________________________________ > > > From: Daan Hoogland <daan.hoogl...@gmail.com> > > > Sent: Thursday, November 12, 2020 1:05 PM > > > To: dev <dev@cloudstack.apache.org> > > > Subject: Re: [DISCUSS] python test framework > > > > > > I checked the source code and the last commit is from the 3rd of March. > > > nose2 might require some effort from the community @here as well. > > > > > > On Thu, Nov 12, 2020 at 12:58 PM David Jumani < > > david.jum...@shapeblue.com> > > > wrote: > > > > > > > ++1 and like Boris said, need to look into backward compatibility > > > > ________________________________ > > > > From: Boris Stoyanov <boris.stoya...@shapeblue.com> > > > > Sent: Thursday, November 12, 2020 2:26 PM > > > > To: dev@cloudstack.apache.org <dev@cloudstack.apache.org> > > > > Subject: Re: [DISCUSS] python test framework > > > > > > > > +1 on nose2, as the marvin plugin is built on nose, it seems the > > natural > > > > choice to upgrade to. We need to investigate backwards compatibility > > > > though.. > > > > > > > > Bobby. > > > > > > > > On 11.11.20, 21:28, "Daan Hoogland" <daan.hoogl...@shapeblue.com> > > > wrote: > > > > > > > > devs, > > > > Investigating an new organization of test categories , I found > that > > > > our framework in use, nose, is no longer in maintenance. Its > maintainer > > > has > > > > stopped his support in 2017. As it is quite stable it has slipped our > > > > attention, but it is urgent that we discuss and choose a way forward. > > > There > > > > is a successor, nose2, which as the documentation tells me, has less > > > > support for underlying test types but is also extensible. This is my > > goto > > > > choice to investigate further the coming days, but I’d like input > from > > of > > > > you as many as possible. > > > > Regards, > > > > > > > > daan.hoogl...@shapeblue.com > > > > www.shapeblue.com<http://www.shapeblue.com> > > > > 3 London Bridge Street, 3rd floor, News Building, London SE1 > > 9SGUK > > > > @shapeblue > > > > > > > > > > > > > > > > > > > > > > > > boris.stoya...@shapeblue.com > > > > www.shapeblue.com<http://www.shapeblue.com> > > > > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > > > > @shapeblue > > > > > > > > > > > > > > > > > > > > david.jum...@shapeblue.com > > > > www.shapeblue.com<http://www.shapeblue.com> > > > > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > > > > @shapeblue > > > > > > > > > > > > > > > > > > > > > > -- > > > Daan > > > > > > nicolas.vazq...@shapeblue.com > > > www.shapeblue.com > > > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > > > @shapeblue > > > > > > > > > > > > > > > > -- > > Daan > > >
