Hi, We are at a stage that BVTs are passing at high %age and below are the test results. I have posted results early on but we were at a very low %ages and did not post it even though we are running them on weekly basis on 4.2 code base. But here are the results as these are a little easy to comprehend and showing improved quality status from where we have started. However regression runs are still showing lower pass rates. Once reached to a decent level, will start posting them to community. Thanks to all those who have helped us to get here.
KVM Advanced Stage - almost 99% ( once we fix test case issues, will be reaching 100%) KVM Basic Zone - 95% ( same here TC issues) Defects are being tracked closely to get to 100% this week. KVM Advanced zone: Test cases Total TC's Failed TC's Comments test_vm_life_cycle 10 0 test_affinity_groups 1 0 test_guest_vlan_range 1 0 test_service_offerings 4 0 test_network 7 0 test_loadbalance 3 0 deploy_vms_with_varied_deploymentplanners 3 0 test_iso 6 0 test_internal_lb 3 0 test_secondary_storage 2 0 test_volumes 9 2 i) https://issues.apache.org/jira/browse/CLOUDSTACK-2725 (Need to fix in test case) test_global_settings 1 0 test_deploy_vm_with_userdata 2 0 test_nic 1 0 test_templates 8 0 test_non_contigiousvlan 0 0 test_network_acl 1 0 test_portable_publicip 2 0 test_public_ip_range 1 0 test_pvlan 1 0 test_primary_storage 2 0 test_privategw_acl 1 0 test_regions 1 0 test_resource_detail 1 0 test_routers 9 0 test_disk_offerings 3 0 test_ssvm 10 0 deploy_vm 1 0 94 2 Pass rate 97.87% KVM Basic Zone: Test cases Total TC's Failed TC's Comments test_vm_life_cycle 9 0 test_affinity_groups 1 0 test_service_offerings 3 0 deploy_vms_with_varied_deploymentplanners 3 0 test_iso 6 0 test_secondary_storage 2 0 test_volumes 9 2 i) https://issues.apache.org/jira/browse/CLOUDSTACK-2725 (Need to fix in test case) test_global_settings 1 0 test_deploy_vm_with_userdata 2 0 test_nic 1 0 test_templates 7 0 test_portable_publicip 2 1 https://issues.apache.org/jira/browse/CLOUDSTACK-3454 (test cases issue) test_primary_storage 2 0 test_regions 1 0 test_routers 1 0 test_disk_offerings 3 0 deploy_vm 1 0 test_ssvm 10 0 64 3 Pass rate 95.31 Thanks /sudha
