Hi all,

My considerations after the tests agains XenServer 6.2:

We got 4 failures whilst testing against Xen62:

* test_vpc_redundant.py on line 522
  - AssertionError: No Master or too many master routers found 0
* test_internal_lb.py lines 712 and 576, when trying to deploy a virtual machine
  - Unable to create a deployment for VM[User|i-36-89-VM]
  - Unable to create a deployment for VM[User|i-36-91-VM]
 * test_vpc_vpn.py line 604 for the same reason as above
  - Unable to create a deployment for VM[User|i-37-95-VM]

There are bugs in the test_vpc_vpn.py VPN test: in case of failures, when we 
reach either line 604 or 624, it will try to assert the state of the variable 
vm1/vm2, but is has not been assigned yet, which makes us face an Unbound Error:
  - UnboundLocalError: local variable 'vm1' referenced before assignment

Looking at the code I noticed that the same will happen for vm2, in case vm1 
deployment passes but vm1 doesn’t.

Concerning the LB and VPN tests, those failed due to a wrong template. Those 
tests should be executed against KVM only as they have a configuration which 
depends on KVM hypervisors

```
            "default_hypervisor": "kvm",
            "compute_offering": {
                "name": "Tiny Instance",
                "displaytext": "Tiny Instance",
                "cpunumber": 1,
                "cpuspeed": 100,
                "memory": 128,
            }
```

But I will change that.

Concerning the redundant VPC test that failed, it was due an absence of a 
master router. For some reason, after the self.delete_nat_rules() was called, 
the router switched from Master to Backup, which caused the error. I will 
investigate.

There was also a problem reported by Boris concerning the DEB packages, which 
he already has a PR for ==> https://github.com/apache/cloudstack/pull/1040. 
This is package related, thus I don’t see it as a blocker for the release, 
hence my +1.


::: Full Report :::


:: Environment 1 ::

* Hardware required: TRUE
* Management Server + MySQL on CentOS 7.1
* Two XenServer 6.2 hosts


:: Tests Suites Executed ::

nosetests --with-marvin 
--marvin-config=/data/shared/marvin/mct-zone1-xen1-ISOLATED.cfg -s -a 
tags=advanced,required_hardware=true component/test_vpc_redundant.py 
component/test_routers_iptables_default_policy.py 
component/test_routers_network_ops.py component/test_vpc_router_nics.py 
component/test_password_server.py component/test_router_dhcphosts.py 
smoke/test_loadbalance.py smoke/test_internal_lb.py smoke/test_ssvm.py 
smoke/test_vpc_vpn.py smoke/test_network.py

:: Environment 2 ::

* Hardware required: FALSE
* Management Server + MySQL on CentOS 7.1
* Two XenServer 6.2 hosts


:: Tests Suites Executed ::

nosetests --with-marvin 
--marvin-config=/data/shared/marvin/mct-zone1-xen1-ISOLATED.cfg -s -a 
tags=advanced,required_hardware=false smoke/test_routers.py 
smoke/test_reset_vm_on_reboot.py smoke/test_vm_life_cycle.py 
component/test_vpc_routers.py smoke/test_service_offerings.py 
component/test_vpc_offerings.py smoke/test_network_acl.py 
smoke/test_privategw_acl.py smoke/test_network.py


:: Summary ::

* Tests executes: 75
* Successfull tests: 72
* Skipped tests: 6(*)
* Failed tests: 5(**)

(*) Tests were skipped because I had 2 hosts and the current logic in the tests 
does not cope with that: it lists the hosts and takes the one in index zero
    - host = hosts[0]
(**) Failures and Exceptions being taken into counted

:: Test results for Environment 1 ::


Create a redundant VPC with two networks with two VMs in each network ... === 
TestName: test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Status : 
FAILED ===
FAIL
Create a redundant VPC with two networks with two VMs in each network and check 
default routes ... SKIP: Marvin configuration has no host credentials to        
                            check router services
Test iptables default INPUT/FORWARD policy on RouterVM ... === TestName: 
test_02_routervm_iptables_policies | Status : SUCCESS ===
ok
Test iptables default INPUT/FORWARD policies on VPC router ... === TestName: 
test_01_single_VPC_iptables_policies | Status : SUCCESS ===
ok
Test redundant router internals ... === TestName: 
test_01_isolate_network_FW_PF_default_routes_egress_true | Status : SUCCESS ===
ok
Test redundant router internals ... === TestName: 
test_02_isolate_network_FW_PF_default_routes_egress_false | Status : SUCCESS ===
ok
Test redundant router internals ... === TestName: 
test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | Status : SUCCESS ===
ok
Test redundant router internals ... === TestName: 
test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | Status : SUCCESS ===
ok
Create a VPC with two networks with one VM in each network and test nics after 
destroy ... === TestName: test_01_VPC_nics_after_destroy | Status : SUCCESS ===
ok
Create a VPC with two networks with one VM in each network and test default 
routes ... === TestName: test_02_VPC_default_routes | Status : SUCCESS ===
ok
Check the password file in the Router VM ... === TestName: 
test_isolate_network_password_server | Status : SUCCESS ===
ok
Check that the /etc/dhcphosts.txt doesn't contain duplicate IPs ... === 
TestName: test_router_dhcphosts | Status : SUCCESS ===
ok
Test to create Load balancing rule with source NAT ... === TestName: 
test_01_create_lb_rule_src_nat | Status : SUCCESS ===
ok
Test to create Load balancing rule with non source NAT ... === TestName: 
test_02_create_lb_rule_non_nat | Status : SUCCESS ===
ok
Test for assign & removing load balancing rule ... === TestName: 
test_assign_and_removal_lb | Status : SUCCESS ===
ok
Test to verify access to loadbalancer haproxy admin stats page ... === 
TestName: test02_internallb_haproxy_stats_on_all_interfaces | Status : 
EXCEPTION ===
ERROR
Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 
vm's ... === TestName: test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | 
Status : EXCEPTION ===
ERROR
Test SSVM Internals ... === TestName: test_03_ssvm_internals | Status : SUCCESS 
===
ok
Test CPVM Internals ... SKIP: Marvin configuration has no host                  
          credentials to check router services
Test stop SSVM ... === TestName: test_05_stop_ssvm | Status : SUCCESS ===
ok
Test stop CPVM ... SKIP: Marvin configuration has no host                       
     credentials to check router services
Test reboot SSVM ... === TestName: test_07_reboot_ssvm | Status : SUCCESS ===
ok
Test reboot CPVM ... SKIP: Marvin configuration has no host                     
       credentials to check router services
Test destroy SSVM ... SKIP: Marvin configuration has no host                    
        credentials to check router services
Test destroy CPVM ... === TestName: test_10_destroy_cpvm | Status : SUCCESS ===
ok
Test Remote Access VPN in VPC ... === TestName: test_vpc_remote_access_vpn | 
Status : FAILED ===
FAIL
Test VPN in VPC ... === TestName: test_vpc_site2site_vpn | Status : EXCEPTION 
===
ERROR
Test for port forwarding on source NAT ... === TestName: 
test_01_port_fwd_on_src_nat | Status : SUCCESS ===
ok
Test for port forwarding on non source NAT ... === TestName: 
test_02_port_fwd_on_non_src_nat | Status : SUCCESS ===
ok
Test for reboot router ... === TestName: test_reboot_router | Status : SUCCESS 
===
ok
Test for Router rules for network rules on acquired public IP ... === TestName: 
test_network_rules_acquired_public_ip_1_static_nat_rule | Status : SUCCESS ===
ok
Test for Router rules for network rules on acquired public IP ... === TestName: 
test_network_rules_acquired_public_ip_2_nat_rule | Status : SUCCESS ===
ok
Test for Router rules for network rules on acquired public IP ... === TestName: 
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Status : SUCCESS 
===
ok
----------------------------------------------------------------------
Ran 33 tests in 9352.773s

FAILED (SKIP=5, errors=3, failures=2)
(END)


:: Test results for Environment 2 ::

Test router internal advanced zone ... SKIP: Marvin configuration has no host 
credentials                            to check router services
Test restart network ... === TestName: test_03_restart_network_cleanup | Status 
: SUCCESS ===
ok
Test router basic setup ... === TestName: test_05_router_basic | Status : 
SUCCESS ===
ok
Test router advanced setup ... === TestName: test_06_router_advanced | Status : 
SUCCESS ===
ok
Test stop router ... === TestName: test_07_stop_router | Status : SUCCESS ===
ok
Test start router ... === TestName: test_08_start_router | Status : SUCCESS ===
ok
Test reboot router ... === TestName: test_09_reboot_router | Status : SUCCESS 
===
ok
Test reset virtual machine on reboot ... === TestName: 
test_01_reset_vm_on_reboot | Status : SUCCESS ===
ok
Test advanced zone virtual router ... === TestName: test_advZoneVirtualRouter | 
Status : SUCCESS ===
ok
Test Deploy Virtual Machine ... === TestName: test_deploy_vm | Status : SUCCESS 
===
ok
Test Multiple Deploy Virtual Machine ... === TestName: test_deploy_vm_multiple 
| Status : SUCCESS ===
ok
Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status : SUCCESS 
===
ok
Test Start Virtual Machine ... === TestName: test_02_start_vm | Status : 
SUCCESS ===
ok
Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm | Status : 
SUCCESS ===
ok
Test destroy Virtual Machine ... === TestName: test_06_destroy_vm | Status : 
SUCCESS ===
ok
Test recover Virtual Machine ... === TestName: test_07_restore_vm | Status : 
SUCCESS ===
ok
Test migrate VM ... === TestName: test_08_migrate_vm | Status : SUCCESS ===
ok
Test destroy(expunge) Virtual Machine ... === TestName: test_09_expunge_vm | 
Status : SUCCESS ===
ok
Test start/stop of router after addition of one guest network ... === TestName: 
test_01_start_stop_router_after_addition_of_one_guest_network | Status : 
SUCCESS ===
ok
Test reboot of router after addition of one guest network ... === TestName: 
test_02_reboot_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test to change service offering of router after addition of one guest network 
... === TestName: 
test_04_chg_srv_off_router_after_addition_of_one_guest_network | Status : 
SUCCESS ===
ok
Test destroy of router after addition of one guest network ... === TestName: 
test_05_destroy_router_after_addition_of_one_guest_network | Status : SUCCESS 
===
ok
Test to stop and start router after creation of VPC ... === TestName: 
test_01_stop_start_router_after_creating_vpc | Status : SUCCESS ===
ok
Test to reboot the router after creating a VPC ... === TestName: 
test_02_reboot_router_after_creating_vpc | Status : SUCCESS ===
ok
Tests to change service offering of the Router after ... === TestName: 
test_04_change_service_offerring_vpc | Status : SUCCESS ===
ok
Test to destroy the router after creating a VPC ... === TestName: 
test_05_destroy_router_after_creating_vpc | Status : SUCCESS ===
ok
Test to create service offering ... === TestName: 
test_01_create_service_offering | Status : SUCCESS ===
ok
Test to update existing service offering ... === TestName: 
test_02_edit_service_offering | Status : SUCCESS ===
ok
Test to delete service offering ... === TestName: 
test_03_delete_service_offering | Status : SUCCESS ===
ok
Test create VPC offering ... === TestName: test_01_create_vpc_offering | Status 
: SUCCESS ===
ok
Test VPC offering without load balancing service ... === TestName: 
test_03_vpc_off_without_lb | Status : SUCCESS ===
ok
Test VPC offering without static NAT service ... === TestName: 
test_04_vpc_off_without_static_nat | Status : SUCCESS ===
ok
Test VPC offering without port forwarding service ... === TestName: 
test_05_vpc_off_without_pf | Status : SUCCESS ===
ok
Test VPC offering with invalid services ... === TestName: 
test_06_vpc_off_invalid_services | Status : SUCCESS ===
ok
Test update VPC offering ... === TestName: test_07_update_vpc_off | Status : 
SUCCESS ===
ok
Test list VPC offering ... === TestName: test_08_list_vpc_off | Status : 
SUCCESS ===
ok
test_09_create_redundant_vpc_offering 
(integration.component.test_vpc_offerings.TestVPCOffering) ... === TestName: 
test_09_create_redundant_vpc_offering | Status : SUCCESS ===
ok
test_privategw_acl (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... 
=== TestName: test_privategw_acl | Status : SUCCESS ===
ok
Test for delete account ... === TestName: test_delete_account | Status : 
SUCCESS ===
ok
Test for Associate/Disassociate public IP address for admin account ... === 
TestName: test_public_ip_admin_account | Status : SUCCESS ===
ok
Test for Associate/Disassociate public IP address for user account ... === 
TestName: test_public_ip_user_account | Status : SUCCESS ===
ok
Test for release public IP address ... === TestName: test_releaseIP | Status : 
SUCCESS ===
ok

----------------------------------------------------------------------
Ran 42 tests in 5463.487s

OK (SKIP=1)
(END)


On 05 Nov 2015, at 20:13, Nux! <n...@li.nux.ro<mailto:n...@li.nux.ro>> wrote:

Installation on CentOS 6 mgmt and HVs worked great, added some templates, 
deployed some instances, no issues.
I'll get back if I hit problems.

Lucian

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro<http://www.nux.ro>

----- Original Message -----
From: "Nux!" <n...@li.nux.ro>
To: dev@cloudstack.apache.org
Sent: Thursday, 5 November, 2015 08:48:38
Subject: Re: [VOTE] Apache CloudStack 4.6.0

Thanks Remi!

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro

----- Original Message -----
From: "Remi Bergsma" <rberg...@schubergphilis.com>
To: dev@cloudstack.apache.org
Sent: Wednesday, 4 November, 2015 20:45:59
Subject: Re: [VOTE] Apache CloudStack 4.6.0

Kicked off some Jenkins builds:

CentOS 6 packages:
http://jenkins.buildacloud.org/view/parameterized/job/cloudstack-rpm-packages-with-branch-parameter/lastSuccessfulBuild/artifact/dist/rpmbuild/RPMS/x86_64/

CentOS 7 packages:
http://jenkins.buildacloud.org/view/parameterized/job/cloudstack-rpm-packages-with-branch-parameter-centos7/lastSuccessfulBuild/artifact/dist/rpmbuild/RPMS/x86_64/

Ubuntu Trusty packages:
http://cloudstack.apt-get.eu/ubuntu/dists/trusty/4.6/pool/

SystemVM template:
http://jenkins.buildacloud.org/view/parameterized/job/parameterized-sytemvm/lastSuccessfulBuild/artifact/tools/appliance/dist/


You can always build packages from the source:
cd packaging
./package.sh -h

Happy testing!

Regards,
Remi





On 04/11/15 18:12, "Remi Bergsma" <rberg...@schubergphilis.com> wrote:

The jobs failed due to the git clone failing (time out). I also experience it is
quite slow at the moment.

It is mirrored here (same commit id):
https://github.com/apache/cloudstack/tree/4.6.0-RC20151104T1522

Regards,
Remi




On 04/11/15 17:17, "Rajani Karuturi" <rajani.karut...@citrix.com> wrote:

I started jenkins builds for cloudstack RPM packages and systemvm templates for
this branch here

http://jenkins.buildacloud.org/view/parameterized/job/cloudstack-rpm-packages-with-branch-parameter/19/console
http://jenkins.buildacloud.org/view/parameterized/job/parameterized-sytemvm/3/console

We can use them once the build is complete.

~Rajani

On 04-Nov-2015, at 8:58 PM, Nux! <n...@li.nux.ro<mailto:n...@li.nux.ro>> wrote:

Hi,

Has jenkins built rpms for this somewhere?

--
Sent from the Delta quadrant using Borg technology!

Nux!
www.nux.ro<http://www.nux.ro>

----- Original Message -----
From: "Remi Bergsma" <rberg...@schubergphilis.com>
To: dev@cloudstack.apache.org
Sent: Wednesday, 4 November, 2015 14:55:11
Subject: [VOTE] Apache CloudStack 4.6.0

Hi all,

I've created a 4.6.0 release candidate, with the following artifacts up for a
vote:

Git Branch and Commit SH:
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=4.6.0-RC20151104T1522

Commit: b0ebe68e375432b28eef031ab62ccd5831234c77

Source release (checksums and signatures are available at the same
location):
https://dist.apache.org/repos/dist/dev/cloudstack/4.6.0/

PGP release keys (signed using A47DDC4F):
https://dist.apache.org/repos/dist/release/cloudstack/KEYS

Vote will be open for at least 72 hours.

For sanity in tallying the vote, can PMC members please be sure to indicate
"(binding)" with their vote?

[ ] +1  approve
[ ] +0  no opinion
[ ] -1  disapprove (and reason why)

Reply via email to