Hi, Victor,

This is a common script for Functest. If
 it's the bug as you mentioned, then all
features functest will have same issue.

Is there other feature functest also failed due to this?

Best Regards
Chaoyi Huang(joehuang)
发件人:viktor.tikkanen
收件人:黄朝意,opnfv-tech-discuss,
时间:2016-08-19 19:13:35
主题:RE: [opnfv-tech-discuss] [Functest][Multisite] check_os.sh failed during 
openstack endpoint list

Hi!

It seems that "openstack endpoint list" command doesn't exit with 0. You can 
remove " >/dev/null" from the following part of 
/home/opnfv/repos/functest/ci/check_os.sh script:

echo "Checking OpenStack basic services:"
commands=('openstack endpoint list' 'nova list' 'neutron net-list' \
            'glance image-list' 'cinder list')
for cmd in "${commands[@]}"
do
    service=$(echo $cmd | awk '{print $1}')
    echo ">>Checking $service service..."
    $cmd &>/dev/null
    result=$?
    if [ $result -ne 0 ];
    then
        echo "ERROR: Failed execution $cmd. The $service does not seem to be 
working."
        exit 1
    else
        echo "  ...OK"
    fi
done

and check the output of "functest env prepare".

-Viktor

From: joehuang [mailto:[email protected]]
Sent: Friday, August 19, 2016 11:35 AM
To: Tikkanen, Viktor (Nokia - FI/Espoo) <[email protected]>; 
[email protected]
Subject: RE: [opnfv-tech-discuss] [Functest][Multisite] check_os.sh failed 
during openstack endpoint list


Hello,



How long for the time-out for openstack client request? And how to adjust the 
configuration? I am afraid that the time-out setting is too short. For the 
OpenStack catalog command is called before OpenStack endpoint list and succeed 
in check_os.sh



Best Regards

Chaoyi Huang ( joehuang )





________________________________
From: joehuang
Sent: 19 August 2016 14:38
To: Tikkanen, Viktor (Nokia - FI/Espoo); 
[email protected]<mailto:[email protected]>
Subject: RE: [opnfv-tech-discuss] [Functest][Multisite] check_os.sh failed 
during openstack endpoint list

Hi, Tikkanen,



the files is as following:



~/functest/conf/openstack.creds



#!/bin/sh
export LC_ALL=C
export OS_NO_CACHE='true'
export OS_TENANT_NAME='admin'
export OS_PROJECT_NAME='admin'
export OS_USERNAME='admin'
export OS_PASSWORD='admin'
export OS_AUTH_URL='http://172.16.0.3:5000/v2.0'
export OS_DEFAULT_DOMAIN='default'
export OS_AUTH_STRATEGY='keystone'
export OS_REGION_NAME='RegionOne'
export CINDER_ENDPOINT_TYPE='publicURL'
export GLANCE_ENDPOINT_TYPE='publicURL'
export KEYSTONE_ENDPOINT_TYPE='publicURL'
export NOVA_ENDPOINT_TYPE='publicURL'
export NEUTRON_ENDPOINT_TYPE='publicURL'
export OS_ENDPOINT_TYPE='publicURL'



In functest container, run "openstack endpoint list":



root@17040faba298<mailto:root@17040faba298>:~# source 
functest/conf/openstack.creds
root@17040faba298<mailto:root@17040faba298>:~# openstack endpoint list --long
+--------------------+-----------+----------------+----------------+--------------------+--------------------+-----------------------+
| ID                 | Region    | Service Name   | Service Type   | PublicURL  
        | AdminURL           | InternalURL           |
+--------------------+-----------+----------------+----------------+--------------------+--------------------+-----------------------+
| 4941ef85f96f457d99 | RegionOne | heat           | orchestration  | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:80 |
| 4ed1cfaaa94b88     |           |                |                | 
8004/v1/%(tenant_i | :8004/v1/%(tenant_ | 04/v1/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| 748ee23c95b34ff5bf | RegionOne | heat-cfn       | cloudformation | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:80 |
| 0b3e907eaeaf57     |           |                |                | 8000/v1    
        | :8000/v1           | 00/v1                 |
| 6f47a961aa3a475eb6 | RegionTwo | heat           | orchestration  | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:80 |
| 513acdda5d5c9f     |           |                |                | 
8004/v1/%(tenant_i | :8004/v1/%(tenant_ | 04/v1/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| 469204785acf4efe85 | RegionOne | cinderv2       | volumev2       | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:87 |
| f5cec945eaa9ef     |           |                |                | 
8776/v2/%(tenant_i | :8776/v2/%(tenant_ | 76/v2/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| 1bf4582b82394d018d | RegionTwo | nova           | compute        | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:87 |
| e5d9473dabb120     |           |                |                | 8774/v2.1  
        | :8774/v2.1         | 74/v2.1               |
| aaf73744c8734e8a9e | RegionOne | keystone       | identity       | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:50 |
| 477fd2f0fee27b     |           |                |                | 5000/v2.0  
        | :35357/v2.0        | 00/v2.0               |
| 99c679651d494b2d91 | RegionTwo | heat-cfn       | cloudformation | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:80 |
| 8514f6d4bb5cfd     |           |                |                | 8000/v1    
        | :8000/v1           | 00/v1                 |
| d7a0b63d959a4eadad | RegionOne | swift          | object-store   | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:80 |
| 9cf74651536905     |           |                |                | 
8080/swift/v1      | :8080/swift/v1     | 80/swift/v1           |
| 01ad2234d04e46eeb1 | RegionOne | nova           | compute        | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:87 |
| 93ea2048d9bc03     |           |                |                | 8774/v2.1  
        | :8774/v2.1         | 74/v2.1               |
| ac33289bebd7446780 | RegionTwo | compute_legacy | compute_legacy | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:87 |
| ce028a34895dfc     |           |                |                | 
8774/v2/%(tenant_i | :8774/v2/%(tenant_ | 74/v2/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| 1d711df9ae284520a1 | RegionOne | cinder         | volume         | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:87 |
| a3d904e4b7aaf5     |           |                |                | 
8776/v1/%(tenant_i | :8776/v1/%(tenant_ | 76/v1/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| 1c4c9fc1659c4297a3 | RegionTwo | glance         | image          | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:92 |
| ea15d3347ee64e     |           |                |                | 9292       
        | :9292              | 92                    |
| 8ed84ee7b1b24e5980 | RegionOne | cinderv3       | volumev3       | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:87 |
| aef437b63dff73     |           |                |                | 
8776/v3/%(tenant_i | :8776/v3/%(tenant_ | 76/v3/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| 88c3bbc91f56485d93 | RegionTwo | swift          | object-store   | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:80 |
| 162837c39c0851     |           |                |                | 
8080/swift/v1      | :8080/swift/v1     | 80/swift/v1           |
| 80ca64f3289c4d3680 | RegionOne | glance         | image          | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:92 |
| b74165cb532873     |           |                |                | 9292       
        | :9292              | 92                    |
| fd8ab9c9d4ff42bb8f | RegionTwo | cinderv2       | volumev2       | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:87 |
| 616c642647e150     |           |                |                | 
8776/v2/%(tenant_i | :8776/v2/%(tenant_ | 76/v2/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| afcb84b3ebfd410e8e | RegionTwo | swift          | object-store   | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:94 |
| c8488548653a30     |           |                |                | 9494       
        | :9494              | 94                    |
| f771cb73a1e7411eb4 | RegionOne | neutron        | network        | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:96 |
| 019c739f4a1374     |           |                |                | 9696       
        | :9696              | 96                    |
| 4668f705b7ab47b2a3 | RegionOne | kingbird       | multisite      | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:81 |
| 897adaf3f7ed5e     |           |                |                | 8118/v1.0  
        | :8118/v1.0         | 18/v1.0               |
| 1224094a5c584aa2b1 | RegionOne | glare          | artifact       | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:94 |
| 49255bde9c041c     |           |                |                | 9494       
        | :9494              | 94                    |
| 3df9f196d90c406ba7 | RegionTwo | cinderv3       | volumev3       | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:87 |
| 13534853d9b3de     |           |                |                | 
8776/v3/%(tenant_i | :8776/v3/%(tenant_ | 76/v3/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| 9a12e06f17f64823a2 | RegionTwo | cinder         | volume         | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:87 |
| 38aa02d0f1b733     |           |                |                | 
8776/v1/%(tenant_i | :8776/v1/%(tenant_ | 76/v1/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
| 32bdb2c87202471ba6 | RegionTwo | neutron        | network        | 
http://172.16.0.6: | http://192.168.0.8 | http://192.168.0.8:96 |
| 4f265ecaa948b9     |           |                |                | 9696       
        | :9696              | 96                    |
| 014bc8e2baeb4bf780 | RegionOne | compute_legacy | compute_legacy | 
http://172.16.0.3: | http://192.168.0.2 | http://192.168.0.2:87 |
| 8e921a0ce4f182     |           |                |                | 
8774/v2/%(tenant_i | :8774/v2/%(tenant_ | 74/v2/%(tenant_id)s   |
|                    |           |                |                | d)s        
        | id)s               |                       |
+--------------------+-----------+----------------+----------------+--------------------+--------------------+-----------------------+





The openrc in fuel master:



#!/bin/sh
export LC_ALL=C
export OS_NO_CACHE='true'
export OS_TENANT_NAME='admin'
export OS_PROJECT_NAME='admin'
export OS_USERNAME='admin'
export OS_PASSWORD='admin'
export OS_AUTH_URL='http://192.168.0.2:5000/'
export OS_DEFAULT_DOMAIN='default'
export OS_AUTH_STRATEGY='keystone'
export OS_REGION_NAME='RegionOne'
export CINDER_ENDPOINT_TYPE='internalURL'
export GLANCE_ENDPOINT_TYPE='internalURL'
export KEYSTONE_ENDPOINT_TYPE='internalURL'
export NOVA_ENDPOINT_TYPE='internalURL'
export NEUTRON_ENDPOINT_TYPE='internalURL'
export OS_ENDPOINT_TYPE='internalURL'





________________________________
From: Tikkanen, Viktor (Nokia - FI/Espoo) [[email protected]]
Sent: 19 August 2016 14:18
To: joehuang; 
[email protected]<mailto:[email protected]>
Subject: RE: [opnfv-tech-discuss] [Functest][Multisite] check_os.sh failed 
during openstack endpoint list
Hi!

Can you please send the content of /root/openrc  in controller node so as 
content of ~/functest/conf/openstack.creds? Note that releng replaces original 
OS_AUTH_URL with keystone public endpoint:

if [ "$public_ip" != "" ]; then
    info "Exchanging keystone public IP in rc file to $public_ip"
    sed -i  "/OS_AUTH_URL/c\export OS_AUTH_URL=\'$public_ip'" $dest_path
fi

-Viktor

From: 
[email protected]<mailto:[email protected]>
 [mailto:[email protected]] On Behalf Of joehuang
Sent: Friday, August 19, 2016 8:46 AM
To: 
[email protected]<mailto:[email protected]>
Subject: [opnfv-tech-discuss] [Functest][Multisite] check_os.sh failed during 
openstack endpoint list


Hello, Functest and Multisite:



The CI job failed again and again at "OpenStack endpoint list" in check_os.sh. 
But if log into the Functest container, and "source 
~/functest/conf/openstack.creds" , then manually execute "OpenStack endpoint 
list", it succeeds.



Please help to find out why the check_os.sh failed.



================================================================



https://build.opnfv.org/ci/job/functest-fuel-virtual-suite-master/64/console



https://build.opnfv.org/ci/job/functest-fuel-virtual-suite-master/63/console



https://build.opnfv.org/ci/job/functest-fuel-virtual-suite-master/56/console



..............



Started by user m00133142<https://build.opnfv.org/ci/user/m00133142>

[EnvInject] - Loading node environment variables.

Building remotely on 
intel-virtual6<https://build.opnfv.org/ci/computer/intel-virtual6> 
(opnfv-sysinfo multisite ci-resource) in workspace 
/home/jenkins/opnfv/slave_root/workspace/functest-fuel-virtual-suite-master

Wiping out workspace first.

Cloning the remote Git repository

Cloning repository https://gerrit.opnfv.org/gerrit/functest

 > git init 
 > /home/jenkins/opnfv/slave_root/workspace/functest-fuel-virtual-suite-master 
 > # timeout=10

...............................

2016-08-19 05:11:47,270 - prepare_env - INFO - ######### Preparing Functest 
environment #########



2016-08-19 05:11:47,271 - prepare_env - INFO - 
==============================================

2016-08-19 05:11:47,271 - prepare_env - INFO - Checking environment variables...

2016-08-19 05:11:47,271 - prepare_env - INFO -     INSTALLER_TYPE=fuel

2016-08-19 05:11:47,271 - prepare_env - INFO -     INSTALLER_IP=10.20.0.2

2016-08-19 05:11:47,271 - prepare_env - INFO -     
DEPLOY_SCENARIO=os-odl_l2-multisite-ha

2016-08-19 05:11:47,271 - prepare_env - INFO -     CI_DEBUG=false

2016-08-19 05:11:47,271 - prepare_env - INFO -     NODE_NAME=intel-virtual6

2016-08-19 05:11:47,271 - prepare_env - INFO -     
BUILD_TAG=jenkins-functest-fuel-virtual-suite-master-64

2016-08-19 05:11:47,271 - prepare_env - INFO - 
==============================================

2016-08-19 05:11:47,271 - prepare_env - INFO - Creating needed directories...

2016-08-19 05:11:47,272 - prepare_env - INFO - 
==============================================

2016-08-19 05:11:47,272 - prepare_env - INFO - Fetching RC file...

2016-08-19 05:11:47,272 - prepare_env - INFO - RC file not provided. Fetching 
it from the installer...

fetch_os_creds.info: Verifying connectivity to 10.20.0.2...

fetch_os_creds.info: 10.20.0.2 is reachable!

fetch_os_creds.info: Fetching rc file from controller 10.20.0.3...

Warning: Permanently added '10.20.0.2' (ECDSA) to the list of known hosts.

Warning: Permanently added '10.20.0.3' (ECDSA) to the list of known hosts.

fetch_os_creds.info: Exchanging keystone public IP in rc file to 
http://172.16.0.3:5000/v2.0

2016-08-19 05:11:53,358 - prepare_env - INFO - Sourcing the OpenStack RC file...

2016-08-19 05:11:53,371 - prepare_env - INFO - 
==============================================

2016-08-19 05:11:53,371 - prepare_env - INFO - Verifying OpenStack services...

2016-08-19 05:11:53,378 - prepare_env - INFO - Checking OpenStack endpoints:

2016-08-19 05:11:53,386 - prepare_env - INFO - >>Verifying connectivity to the 
public endpoint 172.16.0.3:5000...

2016-08-19 05:11:53,393 - prepare_env - INFO -   ...OK

2016-08-19 05:11:54,520 - prepare_env - INFO - >>Verifying connectivity to the 
admin endpoint 192.168.0.2:35357...

2016-08-19 05:11:54,526 - prepare_env - INFO -   ...OK

2016-08-19 05:11:54,526 - prepare_env - INFO - Checking OpenStack basic 
services:

2016-08-19 05:11:54,530 - prepare_env - INFO - >>Checking openstack service...

2016-08-19 05:11:59,269 - prepare_env - ERROR - ERROR: Failed execution 
openstack endpoint list. The openstack does not seem to be working.

Problem while running 'check_os.sh'.

Build step 'Execute shell' marked build as failure

Finished: FAILURE
_______________________________________________
opnfv-tech-discuss mailing list
[email protected]
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss

Reply via email to