Hi Raja, Yes, those were moved and have been tested - as they to smoke tests instead of component. All of them are passing and they have been executed not only by me. There are all green on both KVM and Xen.
You can find my DC configurations here: https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-kvm1-ISOLATED.cfg https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-xen1-ISOLATED.cfg But the tests do not depend on anything special. The templates I use can be found here: http://dl.openvm.eu/cloudstack/macchinina/x86_64/ Cheers, Wilder On 15 Dec 2015, at 12:37, Raja Pullela <raja.pull...@citrix.com<mailto:raja.pull...@citrix.com>> wrote: Sebastien, Yes, was looking at the details, found out the following details on the failures: 1) CLOUDSTACK-9120 - Moves tests to the smoke directory - test_router_dhcphosts.py, test_routers_iptables_default_policy.py, test_routers_network_ops.py, test_vpc_redundant.py, test_vpc_router_nics.py. the changes were done around a week ago. 2) CLOUDSTACK-9153: When negative credits are added to an account- test_quota.py. This one added by Abhinandan Prateek. I did see the PR related this with results showing it is passing. However, in my env these tests were failing with error " global name 'quotaTariffList' is not defined". Wilder, can you comment on if all the tests in these scripts were passing in your env? Best, Raja -----Original Message----- From: Sebastien Goasguen [mailto:run...@gmail.com] Sent: Tuesday, December 15, 2015 3:31 PM To: dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org> Subject: Re: BVT report for week of 12/14 On Dec 15, 2015, at 10:45 AM, Raja Pullela <raja.pull...@citrix.com<mailto:raja.pull...@citrix.com>> wrote: Hi, Here is the BVT report for this week - - XS Basic - 97.0% (4.6 RC passrate 96.9%) - XS Adv - 79.5% (4.6 RC passrate 93.4%) // went down from 92.7% to 79.5% Hi Raja, with very few commits getting into master it should be relatively easy to identify the commits responsible for this. Do you know which one(s) it was. - KVM Basic - 98.6% (4.6 RC passrate - 98.6%) - KVM Adv - 79.7% (4.6 RC passrate - 96.3%) // went down from 96.4% to 79.7% Summary: - Breakage in Adv Network cases, the following suites need to be run both Xen and Adv - test_quota.py - all the test failing, we should look at the PR that has checked in this code. - test_vpc_vpn.py - couple of tests failing - test_vpc_redundant.py - couple of test failing - test_routers_network_ops.py - 5-6 tests failing - test_routers_iptables_default_policy.py - - test_privategw_acl.py Let me know if you have any questions, Raja Following are the failed tests: - XS Basic (both the following are test script issues) - integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu me_snapshot - integration.smoke.test_iso.TestISO.test_07_list_default_iso - KVM Basic (following is a test script issue) - integration.smoke.test_iso.TestISO.test_07_list_default_iso //known testcase issue - XS Adv - integration.smoke.test_nic.TestNic.test_01_nic - integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0 2_isolate_network_FW_PF_default_routes_egress_false - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup - integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab lesPolicies.test_02_routervm_iptables_policies - integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables Policies.test_01_single_VPC_iptables_policies - integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0 1_isolate_network_FW_PF_default_routes_egress_true - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork s.test_03_RVR_Network_check_router_state - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda nt_VPC_default_routes - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_03_create_ redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers - integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default _routes - integration.smoke.test_quota.TestQuota.test_01_quota - integration.smoke.test_quota.TestQuota.test_02_quota - integration.smoke.test_quota.TestQuota.test_03_quota - integration.smoke.test_quota.TestQuota.test_04_quota - integration.smoke.test_quota.TestQuota.test_05_quota - integration.smoke.test_quota.TestQuota.test_06_quota - integration.smoke.test_quota.TestQuota.test_07_quota - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv ategw_static_routes - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv ategw_static_routes - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri vategw_static_routes - integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_ access_vpn - integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_ vpn - integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_ha proxy_stats_on_all_interfaces - integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu me_snapshot - integration.smoke.test_iso.TestISO.test_07_list_default_iso - KVM ADV - integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_v m_from_iso - integration.smoke.test_routers.TestRouterServices.test_04_restart_netw ork_wo_cleanup - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork s.test_03_RVR_Network_check_router_state - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_ redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_ redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup - integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab lesPolicies.test_02_routervm_iptables_policies - integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables Policies.test_01_single_VPC_iptables_policies - integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0 1_isolate_network_FW_PF_default_routes_egress_true - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda nt_VPC_default_routes - integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default _routes - integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_r oundrobin_1VPC_3VM_HTTP_port80 - integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_ vpn - integration.smoke.test_quota.TestQuota.test_01_quota - integration.smoke.test_quota.TestQuota.test_02_quota - integration.smoke.test_quota.TestQuota.test_03_quota - integration.smoke.test_quota.TestQuota.test_04_quota - integration.smoke.test_quota.TestQuota.test_05_quota - integration.smoke.test_quota.TestQuota.test_06_quota - integration.smoke.test_quota.TestQuota.test_07_quota - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv ategw_static_routes - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv ategw_static_routes - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri vategw_static_routes - integration.smoke.test_iso.TestISO.test_07_list_default_iso ---------------------------------------------------------------------- --end-----------------------
