Hi all, My considerations after the tests agains XenServer 6.2:
We got 4 failures whilst testing against Xen62: * test_vpc_redundant.py on line 522 - AssertionError: No Master or too many master routers found 0 * test_internal_lb.py lines 712 and 576, when trying to deploy a virtual machine - Unable to create a deployment for VM[User|i-36-89-VM] - Unable to create a deployment for VM[User|i-36-91-VM] * test_vpc_vpn.py line 604 for the same reason as above - Unable to create a deployment for VM[User|i-37-95-VM] There are bugs in the test_vpc_vpn.py VPN test: in case of failures, when we reach either line 604 or 624, it will try to assert the state of the variable vm1/vm2, but is has not been assigned yet, which makes us face an Unbound Error: - UnboundLocalError: local variable 'vm1' referenced before assignment Looking at the code I noticed that the same will happen for vm2, in case vm1 deployment passes but vm1 doesn’t. Concerning the LB and VPN tests, those failed due to a wrong template. Those tests should be executed against KVM only as they have a configuration which depends on KVM hypervisors ``` "default_hypervisor": "kvm", "compute_offering": { "name": "Tiny Instance", "displaytext": "Tiny Instance", "cpunumber": 1, "cpuspeed": 100, "memory": 128, } ``` But I will change that. Concerning the redundant VPC test that failed, it was due an absence of a master router. For some reason, after the self.delete_nat_rules() was called, the router switched from Master to Backup, which caused the error. I will investigate. There was also a problem reported by Boris concerning the DEB packages, which he already has a PR for ==> https://github.com/apache/cloudstack/pull/1040. This is package related, thus I don’t see it as a blocker for the release, hence my +1. ::: Full Report ::: :: Environment 1 :: * Hardware required: TRUE * Management Server + MySQL on CentOS 7.1 * Two XenServer 6.2 hosts :: Tests Suites Executed :: nosetests --with-marvin --marvin-config=/data/shared/marvin/mct-zone1-xen1-ISOLATED.cfg -s -a tags=advanced,required_hardware=true component/test_vpc_redundant.py component/test_routers_iptables_default_policy.py component/test_routers_network_ops.py component/test_vpc_router_nics.py component/test_password_server.py component/test_router_dhcphosts.py smoke/test_loadbalance.py smoke/test_internal_lb.py smoke/test_ssvm.py smoke/test_vpc_vpn.py smoke/test_network.py :: Environment 2 :: * Hardware required: FALSE * Management Server + MySQL on CentOS 7.1 * Two XenServer 6.2 hosts :: Tests Suites Executed :: nosetests --with-marvin --marvin-config=/data/shared/marvin/mct-zone1-xen1-ISOLATED.cfg -s -a tags=advanced,required_hardware=false smoke/test_routers.py smoke/test_reset_vm_on_reboot.py smoke/test_vm_life_cycle.py component/test_vpc_routers.py smoke/test_service_offerings.py component/test_vpc_offerings.py smoke/test_network_acl.py smoke/test_privategw_acl.py smoke/test_network.py :: Summary :: * Tests executes: 75 * Successfull tests: 72 * Skipped tests: 6(*) * Failed tests: 5(**) (*) Tests were skipped because I had 2 hosts and the current logic in the tests does not cope with that: it lists the hosts and takes the one in index zero - host = hosts[0] (**) Failures and Exceptions being taken into counted :: Test results for Environment 1 :: Create a redundant VPC with two networks with two VMs in each network ... === TestName: test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Status : FAILED === FAIL Create a redundant VPC with two networks with two VMs in each network and check default routes ... SKIP: Marvin configuration has no host credentials to check router services Test iptables default INPUT/FORWARD policy on RouterVM ... === TestName: test_02_routervm_iptables_policies | Status : SUCCESS === ok Test iptables default INPUT/FORWARD policies on VPC router ... === TestName: test_01_single_VPC_iptables_policies | Status : SUCCESS === ok Test redundant router internals ... === TestName: test_01_isolate_network_FW_PF_default_routes_egress_true | Status : SUCCESS === ok Test redundant router internals ... === TestName: test_02_isolate_network_FW_PF_default_routes_egress_false | Status : SUCCESS === ok Test redundant router internals ... === TestName: test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | Status : SUCCESS === ok Test redundant router internals ... === TestName: test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false | Status : SUCCESS === ok Create a VPC with two networks with one VM in each network and test nics after destroy ... === TestName: test_01_VPC_nics_after_destroy | Status : SUCCESS === ok Create a VPC with two networks with one VM in each network and test default routes ... === TestName: test_02_VPC_default_routes | Status : SUCCESS === ok Check the password file in the Router VM ... === TestName: test_isolate_network_password_server | Status : SUCCESS === ok Check that the /etc/dhcphosts.txt doesn't contain duplicate IPs ... === TestName: test_router_dhcphosts | Status : SUCCESS === ok Test to create Load balancing rule with source NAT ... === TestName: test_01_create_lb_rule_src_nat | Status : SUCCESS === ok Test to create Load balancing rule with non source NAT ... === TestName: test_02_create_lb_rule_non_nat | Status : SUCCESS === ok Test for assign & removing load balancing rule ... === TestName: test_assign_and_removal_lb | Status : SUCCESS === ok Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test02_internallb_haproxy_stats_on_all_interfaces | Status : EXCEPTION === ERROR Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's ... === TestName: test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | Status : EXCEPTION === ERROR Test SSVM Internals ... === TestName: test_03_ssvm_internals | Status : SUCCESS === ok Test CPVM Internals ... SKIP: Marvin configuration has no host credentials to check router services Test stop SSVM ... === TestName: test_05_stop_ssvm | Status : SUCCESS === ok Test stop CPVM ... SKIP: Marvin configuration has no host credentials to check router services Test reboot SSVM ... === TestName: test_07_reboot_ssvm | Status : SUCCESS === ok Test reboot CPVM ... SKIP: Marvin configuration has no host credentials to check router services Test destroy SSVM ... SKIP: Marvin configuration has no host credentials to check router services Test destroy CPVM ... === TestName: test_10_destroy_cpvm | Status : SUCCESS === ok Test Remote Access VPN in VPC ... === TestName: test_vpc_remote_access_vpn | Status : FAILED === FAIL Test VPN in VPC ... === TestName: test_vpc_site2site_vpn | Status : EXCEPTION === ERROR Test for port forwarding on source NAT ... === TestName: test_01_port_fwd_on_src_nat | Status : SUCCESS === ok Test for port forwarding on non source NAT ... === TestName: test_02_port_fwd_on_non_src_nat | Status : SUCCESS === ok Test for reboot router ... === TestName: test_reboot_router | Status : SUCCESS === ok Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_1_static_nat_rule | Status : SUCCESS === ok Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_2_nat_rule | Status : SUCCESS === ok Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Status : SUCCESS === ok ---------------------------------------------------------------------- Ran 33 tests in 9352.773s FAILED (SKIP=5, errors=3, failures=2) (END) :: Test results for Environment 2 :: Test router internal advanced zone ... SKIP: Marvin configuration has no host credentials to check router services Test restart network ... === TestName: test_03_restart_network_cleanup | Status : SUCCESS === ok Test router basic setup ... === TestName: test_05_router_basic | Status : SUCCESS === ok Test router advanced setup ... === TestName: test_06_router_advanced | Status : SUCCESS === ok Test stop router ... === TestName: test_07_stop_router | Status : SUCCESS === ok Test start router ... === TestName: test_08_start_router | Status : SUCCESS === ok Test reboot router ... === TestName: test_09_reboot_router | Status : SUCCESS === ok Test reset virtual machine on reboot ... === TestName: test_01_reset_vm_on_reboot | Status : SUCCESS === ok Test advanced zone virtual router ... === TestName: test_advZoneVirtualRouter | Status : SUCCESS === ok Test Deploy Virtual Machine ... === TestName: test_deploy_vm | Status : SUCCESS === ok Test Multiple Deploy Virtual Machine ... === TestName: test_deploy_vm_multiple | Status : SUCCESS === ok Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status : SUCCESS === ok Test Start Virtual Machine ... === TestName: test_02_start_vm | Status : SUCCESS === ok Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm | Status : SUCCESS === ok Test destroy Virtual Machine ... === TestName: test_06_destroy_vm | Status : SUCCESS === ok Test recover Virtual Machine ... === TestName: test_07_restore_vm | Status : SUCCESS === ok Test migrate VM ... === TestName: test_08_migrate_vm | Status : SUCCESS === ok Test destroy(expunge) Virtual Machine ... === TestName: test_09_expunge_vm | Status : SUCCESS === ok Test start/stop of router after addition of one guest network ... === TestName: test_01_start_stop_router_after_addition_of_one_guest_network | Status : SUCCESS === ok Test reboot of router after addition of one guest network ... === TestName: test_02_reboot_router_after_addition_of_one_guest_network | Status : SUCCESS === ok Test to change service offering of router after addition of one guest network ... === TestName: test_04_chg_srv_off_router_after_addition_of_one_guest_network | Status : SUCCESS === ok Test destroy of router after addition of one guest network ... === TestName: test_05_destroy_router_after_addition_of_one_guest_network | Status : SUCCESS === ok Test to stop and start router after creation of VPC ... === TestName: test_01_stop_start_router_after_creating_vpc | Status : SUCCESS === ok Test to reboot the router after creating a VPC ... === TestName: test_02_reboot_router_after_creating_vpc | Status : SUCCESS === ok Tests to change service offering of the Router after ... === TestName: test_04_change_service_offerring_vpc | Status : SUCCESS === ok Test to destroy the router after creating a VPC ... === TestName: test_05_destroy_router_after_creating_vpc | Status : SUCCESS === ok Test to create service offering ... === TestName: test_01_create_service_offering | Status : SUCCESS === ok Test to update existing service offering ... === TestName: test_02_edit_service_offering | Status : SUCCESS === ok Test to delete service offering ... === TestName: test_03_delete_service_offering | Status : SUCCESS === ok Test create VPC offering ... === TestName: test_01_create_vpc_offering | Status : SUCCESS === ok Test VPC offering without load balancing service ... === TestName: test_03_vpc_off_without_lb | Status : SUCCESS === ok Test VPC offering without static NAT service ... === TestName: test_04_vpc_off_without_static_nat | Status : SUCCESS === ok Test VPC offering without port forwarding service ... === TestName: test_05_vpc_off_without_pf | Status : SUCCESS === ok Test VPC offering with invalid services ... === TestName: test_06_vpc_off_invalid_services | Status : SUCCESS === ok Test update VPC offering ... === TestName: test_07_update_vpc_off | Status : SUCCESS === ok Test list VPC offering ... === TestName: test_08_list_vpc_off | Status : SUCCESS === ok test_09_create_redundant_vpc_offering (integration.component.test_vpc_offerings.TestVPCOffering) ... === TestName: test_09_create_redundant_vpc_offering | Status : SUCCESS === ok test_privategw_acl (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_privategw_acl | Status : SUCCESS === ok Test for delete account ... === TestName: test_delete_account | Status : SUCCESS === ok Test for Associate/Disassociate public IP address for admin account ... === TestName: test_public_ip_admin_account | Status : SUCCESS === ok Test for Associate/Disassociate public IP address for user account ... === TestName: test_public_ip_user_account | Status : SUCCESS === ok Test for release public IP address ... === TestName: test_releaseIP | Status : SUCCESS === ok ---------------------------------------------------------------------- Ran 42 tests in 5463.487s OK (SKIP=1) (END) On 05 Nov 2015, at 20:13, Nux! <n...@li.nux.ro<mailto:n...@li.nux.ro>> wrote: Installation on CentOS 6 mgmt and HVs worked great, added some templates, deployed some instances, no issues. I'll get back if I hit problems. Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro<http://www.nux.ro> ----- Original Message ----- From: "Nux!" <n...@li.nux.ro> To: dev@cloudstack.apache.org Sent: Thursday, 5 November, 2015 08:48:38 Subject: Re: [VOTE] Apache CloudStack 4.6.0 Thanks Remi! -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro ----- Original Message ----- From: "Remi Bergsma" <rberg...@schubergphilis.com> To: dev@cloudstack.apache.org Sent: Wednesday, 4 November, 2015 20:45:59 Subject: Re: [VOTE] Apache CloudStack 4.6.0 Kicked off some Jenkins builds: CentOS 6 packages: http://jenkins.buildacloud.org/view/parameterized/job/cloudstack-rpm-packages-with-branch-parameter/lastSuccessfulBuild/artifact/dist/rpmbuild/RPMS/x86_64/ CentOS 7 packages: http://jenkins.buildacloud.org/view/parameterized/job/cloudstack-rpm-packages-with-branch-parameter-centos7/lastSuccessfulBuild/artifact/dist/rpmbuild/RPMS/x86_64/ Ubuntu Trusty packages: http://cloudstack.apt-get.eu/ubuntu/dists/trusty/4.6/pool/ SystemVM template: http://jenkins.buildacloud.org/view/parameterized/job/parameterized-sytemvm/lastSuccessfulBuild/artifact/tools/appliance/dist/ You can always build packages from the source: cd packaging ./package.sh -h Happy testing! Regards, Remi On 04/11/15 18:12, "Remi Bergsma" <rberg...@schubergphilis.com> wrote: The jobs failed due to the git clone failing (time out). I also experience it is quite slow at the moment. It is mirrored here (same commit id): https://github.com/apache/cloudstack/tree/4.6.0-RC20151104T1522 Regards, Remi On 04/11/15 17:17, "Rajani Karuturi" <rajani.karut...@citrix.com> wrote: I started jenkins builds for cloudstack RPM packages and systemvm templates for this branch here http://jenkins.buildacloud.org/view/parameterized/job/cloudstack-rpm-packages-with-branch-parameter/19/console http://jenkins.buildacloud.org/view/parameterized/job/parameterized-sytemvm/3/console We can use them once the build is complete. ~Rajani On 04-Nov-2015, at 8:58 PM, Nux! <n...@li.nux.ro<mailto:n...@li.nux.ro>> wrote: Hi, Has jenkins built rpms for this somewhere? -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro<http://www.nux.ro> ----- Original Message ----- From: "Remi Bergsma" <rberg...@schubergphilis.com> To: dev@cloudstack.apache.org Sent: Wednesday, 4 November, 2015 14:55:11 Subject: [VOTE] Apache CloudStack 4.6.0 Hi all, I've created a 4.6.0 release candidate, with the following artifacts up for a vote: Git Branch and Commit SH: https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=shortlog;h=4.6.0-RC20151104T1522 Commit: b0ebe68e375432b28eef031ab62ccd5831234c77 Source release (checksums and signatures are available at the same location): https://dist.apache.org/repos/dist/dev/cloudstack/4.6.0/ PGP release keys (signed using A47DDC4F): https://dist.apache.org/repos/dist/release/cloudstack/KEYS Vote will be open for at least 72 hours. For sanity in tallying the vote, can PMC members please be sure to indicate "(binding)" with their vote? [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why)