Here are the BVT results based on the latest master, going forward please expect to see an email on the BVTs beginning of every week: - XS Basic - 97.3% (4.6 RC passrate 96.9%) - XS Adv - 92.7% (4.6 RC passrate 93.4%) - KVM Basic - 98.6% (4.6 RC passrate - 98.6%) - KVM Adv - 96.4% (4.6 RC passrate - 96.3%)
Following are failing on both XS Adv and KVM Adv setups and possible product defects * <nose.suite.ContextSuite context=TestVMLifeCycle>:setup //Issue: Failed to create firewall rule * <nose.suite.ContextSuite context=TestCreateVolume>:setup //Issue: Failed to apply port forwarding rule * integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful * integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful Failed Test cases - XS Basic - - integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot // testcase issue - integration.smoke.test_iso.TestISO.test_07_list_default_iso //known testcase issue KVM Basic - * integration.smoke.test_iso.TestCreateIso.test_01_create_iso //Timeout waiting for response from storage host * integration.smoke.test_iso.TestISO.test_07_list_default_iso //known testcase issue XS Adv - * integration.smoke.test_quota.TestQuota.test_01_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_02_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_03_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_04_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_05_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_06_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_07_quota //New tests added, test setup issue * <nose.suite.ContextSuite context=TestVMLifeCycle>:setup //Issue: Failed to create firewall rule * <nose.suite.ContextSuite context=TestCreateVolume>:setup //Issue: Failed to apply port forwarding rule * integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful * integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful * integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_access_vpn * integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_vpn //testcase issue * integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_haproxy_stats_on_all_interfaces //testcase issue * integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 // testcase issue * integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volume_snapshot // testcase issue * integration.smoke.test_iso.TestISO.test_07_list_default_iso // known testcase issue KVM Adv- * integration.smoke.test_quota.TestQuota.test_01_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_02_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_03_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_04_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_05_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_06_quota //New tests added, test setup issue * integration.smoke.test_quota.TestQuota.test_07_quota //New tests added, test setup issue * <nose.suite.ContextSuite context=TestVpcSite2SiteVpn>:setup //Testcase issue * integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful * integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_privategw_static_routes //Issue: Ping to outside world from VM should be successful * integration.smoke.test_iso.TestISO.test_07_list_default_iso //known testcase issue --------------------------------------end---------------------
