I just ran everything because I didn't know what was supposed to be
advanced zone and what wasn't. Out of 50, 16 failed and got 3 errors.
I haven't gone through everything yet, but it looks like most of it is
either stuff that requires a basic zone/specific environment or the
test itself is buggy, such as:
======================================================================
ERROR: Test to create disk offering
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/root/incubator-cloudstack/test/integration/smoke/test_disk_offerings.py",
line 71, in test_01_create_disk_offering
self.services["off"]
File "/usr/local/lib/python2.7/dist-packages/marvin/integration/lib/base.py",
line 1118, in create
if services["storagetype"]:
KeyError: 'storagetype'
On Tue, Jan 29, 2013 at 8:09 PM, Prasanna Santhanam
<prasanna.santha...@citrix.com> wrote:
> Thanks and That's good to know!
>
> While I set up my infra for the tests, Would you be able to share the summary
> of the test run that nose prints out? I want to be able to see how the
> different merges change master when they come in. Would be nice to have a
> baseline.
>
>
>
> ----- Original Message -----
> From: Marcus Sorensen [mailto:shadow...@gmail.com]
> Sent: Wednesday, January 30, 2013 07:41 AM
> To: cloudstack-dev@incubator.apache.org <cloudstack-dev@incubator.apache.org>
> Subject: Re: integration tests requiring advanced zone
>
> Anything short of live migration can probably be tested in advanced zone in
> devcloud. We were able to build some tests against the aforementioned
> Marvin config. Even live migration can be done if you have two devclouds
> joined to the same zone.
> On Jan 28, 2013 11:50 PM, "Prasanna Santhanam" <t...@apache.org> wrote:
>
>> On Tue, Jan 29, 2013 at 04:51:23AM +0530, Marcus Sorensen wrote:
>> > Hi everyone,
>> > How are you currently running integration tests that require an
>> > advanced zone?
>> >
>> > Should we use one of the advanced configs that I checked in (i'd
>> > prefer tools/devcloud/devcloud-advanced_internal-mgt.cfg since it can
>> > run mgt server in devcloud and thus be easier for lots of people to
>> > test standalone)?
>> >
>> > We've just noticed that some of the tests that are written
>> > (test_network.py, etc) require advanced networking, and to my
>> > knowledge nobody else has been running devcloud this way, so I can't
>> > imagine the integration tests have been running in devcloud.
>>
>> The entire suite of tests haven't been running. Only those that are
>> suitable for devcloud are running within basic zone. This includes
>> the tests: deployvm, startvm, stopvm, rebootvm, destroyvm, recovervm,
>> expungevm.
>>
>> devcloud-kvm will be good for many tests that don't require multiple
>> hosts.
>>
>> Most tests are really written for advanced zone setups only. To be
>> able to run them all one needs a configuration similar to [1].
>>
>> [1] https://github.com/vogxn/cloud-autodeploy/blob/acs-infra-test/xen.cfg
>>
>>
>> --
>> Prasanna.,
>>
