Hi,
I will modify our CI chains in order to alternate check with fraser / master
and keep on providing feedback.
We may change the config to make the dashboard publically available
After one week of perfect runs (last week), we started getting some errors..
api_check / refstack / tempest / rally / patrole (not always the same tests)
but all the errors were linked to volume management
Lots of old test volumes got stuck and it was not possible to delete them.
All the problems were due to cinder operations launched on 1 of the 3
controllers (HA mode), it explains the random effect (sometimes patrole was OK
when cinder operations were done on controler 1 or 2 and fails when done on
controler 3)
It was impossible to delete them properly. There was probably a loss of
synchronization on this controler.
The decision was taken to reboot this controller
After the reboot, fraser tests are back to nominal this morning.
+----------------------------+------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER |
DURATION | RESULT |
+----------------------------+------------------+---------------------+------------------+----------------+
| connection_check | functest | healthcheck |
00:07 | PASS |
| api_check | functest | healthcheck |
09:53 | PASS |
| snaps_health_check | functest | healthcheck |
00:53 | PASS |
+------------------------------+------------------+---------------+------------------+----------------+
| TEST CASE | PROJECT | TIER |
DURATION | RESULT |
+------------------------------+------------------+---------------+------------------+----------------+
| vping_ssh | functest | smoke | 00:56
| PASS |
| vping_userdata | functest | smoke | 00:41
| PASS |
| tempest_smoke_serial | functest | smoke | 18:43
| PASS |
| rally_sanity | functest | smoke | 27:11
| PASS |
| refstack_defcore | functest | smoke | 08:11
| PASS |
| patrole | functest | smoke | 04:57
| PASS |
| snaps_smoke | functest | smoke | 58:07
| PASS |
| odl | functest | smoke | 00:00
| SKIP |
| odl_netvirt | functest | smoke | 00:00
| SKIP |
| neutron_trunk | functest | smoke | 00:00
| SKIP |
+------------------------------+------------------+---------------+------------------+----------------+
vnf tests in progress
it is interesting and shows clearly the need for long duration tests :)
OK for xtesting update.
I am currently trying to finalize some VNF testing that I planned to integrated
in an xtesting/onap-vnf, I will share with the integration team when it will be
more mature
Meanwhile our xtesting/onap-robot is run daily on our Open Lab
/Morgan
Le jeudi 12 avril 2018 à 14:16 +0200, OLLIVIER Cédric IMT/OLN a écrit :
Hello Morgan,
Thank you very much for your help.
All tests done via ONAP OpenLab has been very helpful throughout the F-release
by providing the quickest feedbacks.
We are checking if Functest testcases have to complete Snaps’ garbage
collectors for floating ips.
That would explain this remaining resources.
Yes, we will target live testing for the next release.
http://testresults.opnfv.org/functest/gambiachallenges/
About the reuse of OPNFV in ONAP, Xtesting has been synchronized to Queens this
morning (opnfv/xtesting:latest).
Onap Healthcheck container could inherit from opnfv/xtesting:fraser if it needs
requirements synchronized with OpenStack Pike.
Functest (master) could switch to Queens as well in order to get first
feedbacks before next MS0.
https://gerrit.opnfv.org/gerrit/#/c/55553/
Cédric
De : RICHOMME Morgan IMT/OLN
Envoyé : mardi 10 avril 2018 09:52
À : [email protected]; [email protected]; OLLIVIER
Cédric IMT/OLN
Cc : [email protected]; DEBEAU Eric IMT/OLN; [email protected]
Objet : [OPNFV] [Fraser] Fraser Functest run on Orange ONAP Open lab
Hi
for information, we switched to the fraser version for our daily test on our
ONAP OpenLab, a communit lab for ONAP users.
Even if the lab is used by ONAP contributors for ONAP testing, we are reusing
Functest test suites to be sure that the infrastructure supporting ONAP is
still properly working.
We were using latest tag so far and decided to go to fraser to provide some
feedback for the OPNFV forthcoming release.
The infrastructure has been deployed using XCI/bifrost scripts + Kolla
installer (currently under integration in XCI) on bare metal.
The scenario corresponds to a basic os-nosdn-nofeature-ha scenario.
the results are perfect :)
+----------------------------+------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER |
DURATION | RESULT |
+----------------------------+------------------+---------------------+------------------+----------------+
| connection_check | functest | healthcheck |
00:07 | PASS |
| api_check | functest | healthcheck |
08:26 | PASS |
| snaps_health_check | functest | healthcheck |
00:49 | PASS |
+----------------------------+------------------+---------------------+------------------+----------------+
+------------------------------+------------------+---------------+------------------+----------------+
| TEST CASE | PROJECT | TIER |
DURATION | RESULT |
+------------------------------+------------------+---------------+------------------+----------------+
| vping_ssh | functest | smoke | 00:42
| PASS |
| vping_userdata | functest | smoke | 00:35
| PASS |
| tempest_smoke_serial | functest | smoke | 12:23
| PASS |
| rally_sanity | functest | smoke | 20:46
| PASS |
| refstack_defcore | functest | smoke | 06:53
| PASS |
| patrole | functest | smoke | 04:29
| PASS |
| snaps_smoke | functest | smoke | 50:18
| PASS |
| odl | functest | smoke | 00:00
| SKIP |
| odl_netvirt | functest | smoke | 00:00
| SKIP |
| neutron_trunk | functest | smoke | 00:00
| SKIP |
+------------------------------+------------------+---------------+------------------+----------------+
+----------------------+------------------+--------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION |
RESULT |
+----------------------+------------------+--------------+------------------+----------------+
| cloudify_ims | functest | vnf | 27:40 |
PASS |
| vyos_vrouter | functest | vnf | 18:23 |
PASS |
| juju_epc | functest | vnf | 51:17 |
PASS |
+----------------------+------------------+--------------+------------------+----------------+
Thanks to the functest and XCI team!
Tests will be run daily so we would report any issue if we are facing some but
it looks pretty stable.
Unlike the traditionnal approach, we are running daily tests on a up&running
infrastructure (we do not reinstall it systematically before launching the
tests)
so it is connected somehow to the long duration test acctivities coordinated by
Gabriel
The only issues we faced so far with latest version were due to the cleaning of
the resources (shortages of floatting IPs)
This issue has been identified and will be addressed as far as I understood in
Gambia release.
we run now a cleaning script after the tests to free some resources
As a conclusion, the Orange Onap OpenLab validates the Fraser scenario
os-nosdn-nofeature-ha for XCI/Kolla with functest healthcheck/smoke/vnf
(duration 3h and 20 minutes)
It could be interesting for us to add Yardstick daily tests...it is in the todo
list...
Morgan
_________________________________________________________________________________________________________________________
Ce message et ses pieces jointes peuvent contenir des informations
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou
falsifie. Merci.
This message and its attachments may contain confidential or privileged
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been
modified, changed or falsified.
Thank you.
_______________________________________________
opnfv-tech-discuss mailing list
[email protected]
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
