Hi all,
After my first attempt, which was not so succeed [1], I tried something
different and using a proper approach.
I've deployed from scratch the XCI installer, having as XCI scenario
os-nosdn-nofeature-noha.
The results of those tests were much better:
1- The test scenarios which are related to the healthcheck suite, are run
properly using the opnfv/functest-healthcheck image (attached logs).
2- Whatever I have tried from custom tempest test scenarios which are
related to the opnfv/functest-smoke image, are run properly (attached logs).
The investigation for the rest categories of test scenarios is in progress.
I have uploaded a patch with the impact on dovetail.
The patch is in progress, nothing stable yet.
[1] XCI scenario = os-odl-sfc-noha and executing the SFC test cases (attached
email)
Have a nice weekend!
BR
Panos
Panagiotis Karalis
Software Engineer
SDN/NFV Team
______________________________________
Intracom Telecom
19.7 km Markopoulou Ave., Peania, GR 19002
t: +30 2106671499
<mailto:pkara...@intracom-telecom.com> pkara...@intracom-telecom.com
<http://www.intracom-telecom.com/> www.intracom-telecom.com
JOIN US
MWC Shanghai
26-28 June
Shanghai, China
GITEX Technology Week
6-10 October
Dubai, UAE
MWC Los Angeles
22-24 October
Los Angeles, USA
Futurecom
28-31 October
Sao Paulo, Brazil
AfricaCom
12-14 November
Cape Town, South Africa
MWC Barcelona
24-27 February 2020
Barcelona, Spain
The information in this e-mail message and any attachments are intended only
for the individual or entity to whom it is addressed and may be confidential.
If you have received this transmission in error, and you are not an intended
recipient, be aware that any copying, disclosure, distribution or use of this
transmission or its contents is prohibited. Intracom Telecom and the sender
accept no liability for any loss, disruption or damage to your data or computer
system that may occur while using data contained in, or transmitted with, this
email. Views or opinions expressed in this message may be those of the author
and may not necessarily represent those of Intracom Telecom.
--- Begin Message ---
Hi all,
After an initiative, I've started with a first attempt to introduce the XCI in
the dovetail and as I promised to David,
I' m sending you this email with my progress so far.
Specifically, I tried to deployed the dovetail on XCI installer and run TCs
through dovetail tool.
XCI details:
- OS: Ubuntu (check the rest requirements [1])
- Flavor: mini (for more details [1])
- Deploy Scenario: os-odl-sfc-noha and follow the rest instructions
for SFC deployment with XCI [2]
Waiting until the XCI deployment is completed.
After that, the dovetail tool installation takes place following the relevant
instructions from UG [3] in OPNFV VM of XCI (ssh root@192.168.122.2
<mailto:root@192.168.122.2> ).
My first action was to verify that the containers which have been downloaded
via dovetail project were run properly.
So, using the functest-features:gambia container , I was trying to run
different test scenarios.
At this point, I noticed that the only scenario that was running properly (for
my configuration setup and environment) was the SFC test cases.
After that I tried to run the same scenario through dovetail:
- I prepared a patch in order to trigger this scenario [4].
- I prepared the env_config.sh and pod.yaml files according to the XCI
topology and configuration
- I added in the 'env_config.sh' of dovetail the following parameters
o DEPLOY_SCENARIO=os-odl-sfc-noha
o INSTALLER_TYPE=osa
o INSTALLER_IP=192.168.122.2
o EXTERNAL_NETWORK=ext-net
The result was partially successfully.
The test scenario has been started and the OS components are created
successfully (like routes, networks etc).
At the end, I got an error which seems more or less related to my environment.
As far as I remember, I got the same error when I tried to run the SFC test
case directly through functest-features:gambia
Another alternative that I tried after the aforementioned results
I used the patch [5] changing the relationship between the SFC test cases and
the XCI installer.
[This patch makes the SFC TCs independently from each installer, so the
information like the server's IP is fetched directly from a yaml file that
prepared by user or by dovetail (the pod.yaml in our case)] and not by
installer.
Using this patch, I have skipped the step to add the above parameters in the
environment file (env_config.sh), since this information is retrieved directly
from pod.yaml which is copied in the container from dovetail.
BUT the important thing is that the results are much better.
The investigation is in progress! :)
Let me know if there are questions / comments about the above steps or results.
Moreover, If someone have time to support / contribute this attempt, he/she is
more than welcome!
Have a nice weekend!
BR
Panos
[1]
https://opnfv-releng-xci.readthedocs.io/en/latest/xci-user-guide.html#xci-user-guide
[2] https://wiki.opnfv.org/display/sfc/Deploy+OPNFV+SFC+scenarios
[3]
https://github.com/opnfv/dovetail/blob/master/docs/testing/user/userguide/testing_guide.rst
[4] https://gerrit.opnfv.org/gerrit/#/c/67615/
[5] https://gerrit.opnfv.org/gerrit/#/c/67492/
Panagiotis Karalis
Software Engineer
SDN/NFV Team
______________________________________
Intracom Telecom
19.7 km Markopoulou Ave., Peania, GR 19002
t: +30 2106671499
<mailto:pkara...@intracom-telecom.com> pkara...@intracom-telecom.com
<http://www.intracom-telecom.com/> www.intracom-telecom.com
JOIN US
MWC Shanghai
26-28 June
Shanghai, China
GITEX Technology Week
6-10 October
Dubai, UAE
MWC Los Angeles
22-24 October
Los Angeles, USA
Futurecom
28-31 October
Sao Paulo, Brazil
AfricaCom
12-14 November
Cape Town, South Africa
MWC Barcelona
24-27 February 2020
Barcelona, Spain
The information in this e-mail message and any attachments are intended only
for the individual or entity to whom it is addressed and may be confidential.
If you have received this transmission in error, and you are not an intended
recipient, be aware that any copying, disclosure, distribution or use of this
transmission or its contents is prohibited. Intracom Telecom and the sender
accept no liability for any loss, disruption or damage to your data or computer
system that may occur while using data contained in, or transmitted with, this
email. Views or opinions expressed in this message may be those of the author
and may not necessarily represent those of Intracom Telecom.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#23068):
https://lists.opnfv.org/g/opnfv-tech-discuss/message/23068
Mute This Topic: https://lists.opnfv.org/mt/31246549/1305957
Group Owner: opnfv-tech-discuss+ow...@lists.opnfv.org
Unsubscribe: https://lists.opnfv.org/g/opnfv-tech-discuss/unsub
[mok...@intracom-telecom.com]
-=-=-=-=-=-=-=-=-=-=-=-
--- End Message ---
2019-06-21 12:42:43,624 - run - INFO -
================================================
2019-06-21 12:42:43,625 - run - INFO - Dovetail compliance: ovp.2019.0x!
2019-06-21 12:42:43,625 - run - INFO -
================================================
2019-06-21 12:42:43,625 - run - INFO - Build tag:
daily-master-1061dc10-9422-11e9-86ca-0242ac110002
2019-06-21 12:42:43,625 - run - DEBUG - Executing command: 'cp -r
/etc/dovetail/userconfig/* /root/dovetail/userconfig'
2019-06-21 12:42:43,634 - run - DEBUG - Executing command: 'cp -a -r
/etc/dovetail/patches/* /root/dovetail/patches'
2019-06-21 12:42:43,648 - run - DEBUG - Docker server version: 18.09.5
2019-06-21 12:42:43,929 - run - INFO - >>[testcase]:
functest.healthcheck.connection_check
2019-06-21 12:42:43,930 - test_runner.DockerRunner - DEBUG - Create runner:
functest
2019-06-21 12:42:43,930 - test_runner.DockerRunner - DEBUG - Checking if https
enabled or not...
2019-06-21 12:42:43,930 - test_runner.DockerRunner - DEBUG - https is enabled
2019-06-21 12:42:45,093 - test_runner.DockerRunner - DEBUG - Record all
endpoint info into file /root/dovetail/results/endpoint_info.json.
2019-06-21 12:42:45,093 - test_runner.DockerRunner - INFO - Get hardware info
of all nodes list in file /root/dovetail/pre_config/pod.yaml ...
2019-06-21 12:42:45,100 - test_runner.DockerRunner - DEBUG - Ansible inventory
file is /root/dovetail/results/inventory.ini.
2019-06-21 12:42:47,484 - test_runner.DockerRunner - INFO - Hardware info of
all nodes are stored in file /root/dovetail/results/all_hosts_info.json.
2019-06-21 12:42:48,094 - container.Container - DEBUG - Success to pull docker
image opnfv/functest-healthcheck:hunter!
2019-06-21 12:42:48,099 - container.Container - DEBUG - Image
opnfv/functest-healthcheck:hunter has no changes, no need to remove.
2019-06-21 12:42:48,498 - test_runner.DockerRunner - DEBUG - container id:
c0869742a60a1efb95c8e1bb9e342db958925dd1ceef5bd04b354525478d4ca5
2019-06-21 12:42:48,630 - parser.Parser - DEBUG - name: testcase, eval path:
('name',)
2019-06-21 12:42:48,631 - parser.Parser - DEBUG - name: validate_testcase, eval
path: ('validate', 'testcase')
2019-06-21 12:42:48,631 - parser.Parser - DEBUG - kwargs: {u'testcase':
u'functest.healthcheck.connection_check', u'validate_testcase':
u'connection_check'}
2019-06-21 12:42:48,632 - testcase.Testcase - DEBUG - cmds: [u'run_tests -t
connection_check -r']
2019-06-21 12:42:52,086 - container.Container - DEBUG - container: elated_nobel
was removed
2019-06-21 12:42:52,088 - report.Report - INFO - Results have been stored with
files: [u'/root/dovetail/results/functest_results.txt'].
2019-06-21 12:42:52,088 - report.FunctestCrawler - DEBUG - Create crawler:
functest
2019-06-21 12:42:52,093 - report.Report - DEBUG - Test case: connection_check
-> result acquired
2019-06-21 12:42:52,093 - report.Report - INFO -
Dovetail Report
Version: None
Build Tag: daily-master-1061dc10-9422-11e9-86ca-0242ac110002
Test Date: 2019-06-21 12:42:52 UTC
Duration: 8.16 s
Pass Rate: 100.00% (1/1)
healthcheck: pass rate 100.00%
-functest.healthcheck.connection_check PASS
2019-06-21 12:16:15,925 - run - INFO -
================================================
2019-06-21 12:16:15,925 - run - INFO - Dovetail compliance: ovp.2019.0x!
2019-06-21 12:16:15,925 - run - INFO -
================================================
2019-06-21 12:16:15,925 - run - INFO - Build tag:
daily-master-5e0a4a78-941e-11e9-8bd4-0242ac110002
2019-06-21 12:16:15,926 - run - DEBUG - Executing command: 'cp -r
/etc/dovetail/userconfig/* /root/dovetail/userconfig'
2019-06-21 12:16:15,935 - run - DEBUG - Executing command: 'cp -a -r
/etc/dovetail/patches/* /root/dovetail/patches'
2019-06-21 12:16:15,947 - run - DEBUG - Docker server version: 18.09.5
2019-06-21 12:16:16,223 - run - INFO - >>[testcase]: functest.tempest.compute
2019-06-21 12:16:16,223 - test_runner.DockerRunner - DEBUG - Create runner:
functest
2019-06-21 12:16:16,224 - test_runner.DockerRunner - DEBUG - Checking if https
enabled or not...
2019-06-21 12:16:16,224 - test_runner.DockerRunner - DEBUG - https is enabled
2019-06-21 12:16:17,517 - test_runner.DockerRunner - DEBUG - Record all
endpoint info into file /root/dovetail/results/endpoint_info.json.
2019-06-21 12:16:17,517 - test_runner.DockerRunner - INFO - Get hardware info
of all nodes list in file /root/dovetail/pre_config/pod.yaml ...
2019-06-21 12:16:17,524 - test_runner.DockerRunner - DEBUG - Ansible inventory
file is /root/dovetail/results/inventory.ini.
2019-06-21 12:16:19,857 - test_runner.DockerRunner - INFO - Hardware info of
all nodes are stored in file /root/dovetail/results/all_hosts_info.json.
2019-06-21 12:16:29,422 - container.Container - DEBUG - Success to pull docker
image opnfv/functest-smoke:hunter!
2019-06-21 12:16:29,842 - test_runner.DockerRunner - DEBUG - container id:
b160ed96828c101ea103b0600d532cd3973e74b0338f090be994eaa4f8bce876
2019-06-21 12:16:29,843 - testcase.Testcase - DEBUG - Save test cases to
/root/dovetail/results/tempest_custom.txt
2019-06-21 12:16:30,257 - parser.Parser - DEBUG - name: testcase, eval path:
('name',)
2019-06-21 12:16:30,258 - parser.Parser - DEBUG - name: validate_testcase, eval
path: ('validate', 'testcase')
2019-06-21 12:16:30,258 - parser.Parser - DEBUG - kwargs: {u'testcase':
u'functest.tempest.compute', u'validate_testcase': u'tempest_custom'}
2019-06-21 12:16:30,259 - testcase.Testcase - DEBUG - cmds: [u'run_tests -t
tempest_custom -r']
2019-06-21 12:18:58,412 - container.Container - DEBUG - container:
hardcore_gates was removed
2019-06-21 12:18:58,414 - report.Report - INFO - Results have been stored with
files: [u'/root/dovetail/results/functest_results.txt'].
2019-06-21 12:18:58,414 - report.FunctestCrawler - DEBUG - Create crawler:
functest
2019-06-21 12:18:58,418 - report.Report - DEBUG - Test case: tempest_custom ->
result acquired
2019-06-21 12:18:58,429 - report.Report - INFO -
Dovetail Report
Version: None
Build Tag: daily-master-5e0a4a78-941e-11e9-8bd4-0242ac110002
Test Date: 2019-06-21 12:18:58 UTC
Duration: 162.21 s
Pass Rate: 0.00% (0/1)
tempest: pass rate 0.00%
-functest.tempest.compute FAIL
tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor[id-1f12046b-753d-40d2-abb6-d8eb8b30cb2f,smoke]
PASS
tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors[id-e36c0eaa-dff5-4082-ad1f-3f9a80aa3f59,smoke]
PASS
tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create[id-850795d7-d4d3-4e55-b527-a774c0123d3a,smoke]
PASS
tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list[id-a6154130-5a55-4850-8be4-5e9e796dbf17,smoke]
PASS
tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete[id-eb2b087d-633d-4d0d-a7bd-9e6ba35b32de,smoke]
PASS
tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesUnderV243Test.test_add_remove_fixed_ip[id-c7e0e60b-ee45-43d0-abeb-8596fd42a2f9,network,smoke]
PASS
tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses[id-6eb718c0-02d9-4d5e-acd1-4e0c269cef39,network,smoke]
PASS
tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network[id-87bbc374-5538-4f64-b673-2b0e4443cc30,network,smoke]
PASS
tempest.api.compute.test_versions.TestVersions.test_get_version_details[id-b953a29e-929c-4a8e-81be-ec3a7e03cb76,smoke]
PASS
tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details[id-5de47127-9977-400a-936f-abcfbec1218f,smoke]
SKIP
tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers[id-9a438d88-10c6-4bcd-8b5b-5b6e25e1346f,smoke]
SKIP
tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops[compute,id-7fff3fb3-91d8-4fd0-bd7d-0204f1f180ba,network,smoke]
PASS
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#23266):
https://lists.opnfv.org/g/opnfv-tech-discuss/message/23266
Mute This Topic: https://lists.opnfv.org/mt/32159327/21656
Group Owner: opnfv-tech-discuss+ow...@lists.opnfv.org
Unsubscribe: https://lists.opnfv.org/g/opnfv-tech-discuss/unsub
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
