I agree to modify the pass criteria in functest. It is reasonable to be considered as *functional* OK if the test scripts exit normally.
If supported by functest, it would be nice to have a warning if the performance is below the bar, but this is not a test failure. Meanwhile, I have some questions on the performance deviation on different pods. 1. Which inspector is deployed on the pods which achieved 200ms - 300ms result? 2. If it is linked to enumerating all the hosts, then what configuration is applied on these pod? On Fri, Sep 9, 2016 at 1:42 PM Juvonen, Tomi (Nokia - FI/Espoo) < [email protected]> wrote: > Hi, > > > > This is why inspector should be topology aware, meaning here it should > already know the VMs belonging to the host. Also in real world when event > is received in most cases that need to be analyzed before get to calling > actions to VM or host as need to know what is affected by the event. > > > > What comes to failing testing, I think it is normal to temporarily make it > pass before get the bug fix. Anyhow this is sample inspector, so how > complex code we want to put into it? > > > > Br, > > Tomi > > > > *From:* [email protected] [mailto:[email protected]] > *Sent:* Friday, September 09, 2016 8:00 AM > *To:* Carlos Goncalves <[email protected]>; > [email protected]; [email protected]; Juvonen, Tomi (Nokia - > FI/Espoo) <[email protected]>; [email protected] > *Cc:* [email protected] > *Subject:* [opnfv-tech-discuss] [doctor] For the issue about the > notification time is large than 1S > > > > > Hi doctors, > > For the issue about the notification time is large than 1S. > I check the log and find out that from the inspector received the event > to nova-api begin to handle the reset_state is taken up most of the time, > about over 80%. For example, the total notification time is 2.26s, the > process of inspector takes 1.983s. > > In the test inspector script, we find all the VM under all telant, and > then set all the VM states as error. > As we need to improve the performance,but it can not be handle in a short > time. > > Shall we extned 1S to 3S or change back to no failed to notification time > calculation to let functest green? > Meanwhile doing the performance improvement, then change it back? > > Any suggestions will be welcome. Thank you~ > > BR, > dwj > > > > *董文娟** Wenjuan Dong* > > 控制器四部 / 无线产品 Controller Dept Ⅳ. / Wireless Product Operation > > > [image: image002.jpg] > > [image: image004.jpg] > 上海市浦东新区碧波路889号中兴通讯D3 > D3, ZTE, No. 889, Bibo Rd. > T: +86 021 85922 M: +86 13661996389 > E: [email protected] > www.ztedevice.com > > > _______________________________________________ > opnfv-tech-discuss mailing list > [email protected] > https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss >
_______________________________________________ opnfv-tech-discuss mailing list [email protected] https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
