Hi, Here is the BVT report for this week - - XS Basic - 97.0% (4.6 RC passrate 96.9%) - XS Adv - 79.5% (4.6 RC passrate 93.4%) // went down from 92.7% to 79.5% - KVM Basic - 98.6% (4.6 RC passrate - 98.6%) - KVM Adv - 79.7% (4.6 RC passrate - 96.3%) // went down from 96.4% to 79.7%
Summary: - Breakage in Adv Network cases, the following suites need to be run both Xen and Adv - test_quota.py - all the test failing, we should look at the PR that has checked in this code. - test_vpc_vpn.py - couple of tests failing - test_vpc_redundant.py - couple of test failing - test_routers_network_ops.py - 5-6 tests failing - test_routers_iptables_default_policy.py - - test_privategw_acl.py Let me know if you have any questions, Raja Following are the failed tests: - XS Basic (both the following are test script issues) - integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot - integration.smoke.test_iso.TestISO.test_07_list_default_iso - KVM Basic (following is a test script issue) - integration.smoke.test_iso.TestISO.test_07_list_default_iso //known testcase issue - XS Adv - integration.smoke.test_nic.TestNic.test_01_nic - integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_02_isolate_network_FW_PF_default_routes_egress_false - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup - integration.smoke.test_routers_iptables_default_policy.TestRouterIpTablesPolicies.test_02_routervm_iptables_policies - integration.smoke.test_routers_iptables_default_policy.TestVPCIpTablesPolicies.test_01_single_VPC_iptables_policies - integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_01_isolate_network_FW_PF_default_routes_egress_true - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_03_RVR_Network_check_router_state - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redundant_VPC_default_routes - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers - integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default_routes - integration.smoke.test_quota.TestQuota.test_01_quota - integration.smoke.test_quota.TestQuota.test_02_quota - integration.smoke.test_quota.TestQuota.test_03_quota - integration.smoke.test_quota.TestQuota.test_04_quota - integration.smoke.test_quota.TestQuota.test_05_quota - integration.smoke.test_quota.TestQuota.test_06_quota - integration.smoke.test_quota.TestQuota.test_07_quota - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes - integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_access_vpn - integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_vpn - integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_haproxy_stats_on_all_interfaces - integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot - integration.smoke.test_iso.TestISO.test_07_list_default_iso - KVM ADV - integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_vm_from_iso - integration.smoke.test_routers.TestRouterServices.test_04_restart_network_wo_cleanup - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_03_RVR_Network_check_router_state - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup - integration.smoke.test_routers_iptables_default_policy.TestRouterIpTablesPolicies.test_02_routervm_iptables_policies - integration.smoke.test_routers_iptables_default_policy.TestVPCIpTablesPolicies.test_01_single_VPC_iptables_policies - integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_01_isolate_network_FW_PF_default_routes_egress_true - integration.smoke.test_routers_network_ops.TestRedundantIsolateNetworks.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true - integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redundant_VPC_default_routes - integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default_routes - integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 - integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_vpn - integration.smoke.test_quota.TestQuota.test_01_quota - integration.smoke.test_quota.TestQuota.test_02_quota - integration.smoke.test_quota.TestQuota.test_03_quota - integration.smoke.test_quota.TestQuota.test_04_quota - integration.smoke.test_quota.TestQuota.test_05_quota - integration.smoke.test_quota.TestQuota.test_06_quota - integration.smoke.test_quota.TestQuota.test_07_quota - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes - integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes - integration.smoke.test_iso.TestISO.test_07_list_default_iso ------------------------------------------------------------------------end-----------------------
