Super! Thanks, man!
Cheers, Wilder > On 15 Dec 2015, at 12:57, Raja Pullela <raja.pull...@citrix.com> wrote: > > Ok, will cross check the configurations and rerun them. > > -----Original Message----- > From: Wilder Rodrigues [mailto:wrodrig...@schubergphilis.com] > Sent: Tuesday, December 15, 2015 5:22 PM > To: dev@cloudstack.apache.org > Subject: Re: BVT report for week of 12/14 > > Hi Raja, > > Yes, those were moved and have been tested - as they to smoke tests instead > of component. All of them are passing and they have been executed not only by > me. There are all green on both KVM and Xen. > > You can find my DC configurations here: > > https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-kvm1-ISOLATED.cfg > https://github.com/schubergphilis/MCT-shared/blob/master/marvin/mct-zone1-xen1-ISOLATED.cfg > > But the tests do not depend on anything special. > > The templates I use can be found here: > http://dl.openvm.eu/cloudstack/macchinina/x86_64/ > > Cheers, > Wilder > > On 15 Dec 2015, at 12:37, Raja Pullela > <raja.pull...@citrix.com<mailto:raja.pull...@citrix.com>> wrote: > > Sebastien, Yes, was looking at the details, found out the following details > on the failures: > > 1) CLOUDSTACK-9120 - Moves tests to the smoke directory - > test_router_dhcphosts.py, test_routers_iptables_default_policy.py, > test_routers_network_ops.py, test_vpc_redundant.py, test_vpc_router_nics.py. > the changes were done around a week ago. > > 2) CLOUDSTACK-9153: When negative credits are added to an account- > test_quota.py. This one added by Abhinandan Prateek. I did see the PR > related this with results showing it is passing. However, in my env these > tests were failing with error " global name 'quotaTariffList' is not defined". > > Wilder, can you comment on if all the tests in these scripts were passing in > your env? > > Best, > Raja > -----Original Message----- > From: Sebastien Goasguen [mailto:run...@gmail.com] > Sent: Tuesday, December 15, 2015 3:31 PM > To: dev@cloudstack.apache.org<mailto:dev@cloudstack.apache.org> > Subject: Re: BVT report for week of 12/14 > > > On Dec 15, 2015, at 10:45 AM, Raja Pullela > <raja.pull...@citrix.com<mailto:raja.pull...@citrix.com>> wrote: > > Hi, > > Here is the BVT report for this week - > - XS Basic - 97.0% (4.6 RC passrate 96.9%) > - XS Adv - 79.5% (4.6 RC passrate 93.4%) // went down from 92.7% to 79.5% > > Hi Raja, with very few commits getting into master it should be relatively > easy to identify the commits responsible for this. > Do you know which one(s) it was. > > - KVM Basic - 98.6% (4.6 RC passrate - 98.6%) > - KVM Adv - 79.7% (4.6 RC passrate - 96.3%) // went down from 96.4% to 79.7% > > Summary: > - Breakage in Adv Network cases, the following suites need to be run both Xen > and Adv > - test_quota.py - all the test failing, we should look at the PR that has > checked in this code. > - test_vpc_vpn.py - couple of tests failing > - test_vpc_redundant.py - couple of test failing > - test_routers_network_ops.py - 5-6 tests failing > - test_routers_iptables_default_policy.py - > - test_privategw_acl.py > > Let me know if you have any questions, Raja > > Following are the failed tests: > - XS Basic (both the following are test script issues) > - > integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu > me_snapshot > - integration.smoke.test_iso.TestISO.test_07_list_default_iso > > - KVM Basic (following is a test script issue) > - integration.smoke.test_iso.TestISO.test_07_list_default_iso //known > testcase issue > > - XS Adv > - integration.smoke.test_nic.TestNic.test_01_nic > - > integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0 > 2_isolate_network_FW_PF_default_routes_egress_false > - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup > - > integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab > lesPolicies.test_02_routervm_iptables_policies > - > integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables > Policies.test_01_single_VPC_iptables_policies > - > integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0 > 1_isolate_network_FW_PF_default_routes_egress_true > - > integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork > s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true > - > integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork > s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false > - > integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork > s.test_03_RVR_Network_check_router_state > - > integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda > nt_VPC_default_routes > - > integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_03_create_ > redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers > - > integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default > _routes > - integration.smoke.test_quota.TestQuota.test_01_quota > - integration.smoke.test_quota.TestQuota.test_02_quota > - integration.smoke.test_quota.TestQuota.test_03_quota > - integration.smoke.test_quota.TestQuota.test_04_quota > - integration.smoke.test_quota.TestQuota.test_05_quota > - integration.smoke.test_quota.TestQuota.test_06_quota > - integration.smoke.test_quota.TestQuota.test_07_quota > - > integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv > ategw_static_routes > - > integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv > ategw_static_routes > - > integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri > vategw_static_routes > - > integration.smoke.test_vpc_vpn.TestVpcRemoteAccessVpn.test_vpc_remote_ > access_vpn > - > integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_ > vpn > - > integration.smoke.test_internal_lb.TestInternalLb.test02_internallb_ha > proxy_stats_on_all_interfaces > - > integration.smoke.test_vm_snapshots.TestSnapshots.test_01_test_vm_volu > me_snapshot > - integration.smoke.test_iso.TestISO.test_07_list_default_iso > > - KVM ADV > - > integration.smoke.test_deploy_vm_iso.TestDeployVMFromISO.test_deploy_v > m_from_iso > - > integration.smoke.test_routers.TestRouterServices.test_04_restart_netw > ork_wo_cleanup > - > integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork > s.test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false > - > integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork > s.test_03_RVR_Network_check_router_state > - > integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_ > redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL > - > integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_01_create_ > redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL > - <nose.suite.ContextSuite context=TestRouterDHCPHosts>:setup > - > integration.smoke.test_routers_iptables_default_policy.TestRouterIpTab > lesPolicies.test_02_routervm_iptables_policies > - > integration.smoke.test_routers_iptables_default_policy.TestVPCIpTables > Policies.test_01_single_VPC_iptables_policies > - > integration.smoke.test_routers_network_ops.TestIsolatedNetworks.test_0 > 1_isolate_network_FW_PF_default_routes_egress_true > - > integration.smoke.test_routers_network_ops.TestRedundantIsolateNetwork > s.test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true > - > integration.smoke.test_vpc_redundant.TestVPCRedundancy.test_02_redunda > nt_VPC_default_routes > - > integration.smoke.test_vpc_router_nics.TestVPCNics.test_02_VPC_default > _routes > - > integration.smoke.test_internal_lb.TestInternalLb.test_01_internallb_r > oundrobin_1VPC_3VM_HTTP_port80 > - > integration.smoke.test_vpc_vpn.TestVpcSite2SiteVpn.test_vpc_site2site_ > vpn > - integration.smoke.test_quota.TestQuota.test_01_quota > - integration.smoke.test_quota.TestQuota.test_02_quota > - integration.smoke.test_quota.TestQuota.test_03_quota > - integration.smoke.test_quota.TestQuota.test_04_quota > - integration.smoke.test_quota.TestQuota.test_05_quota > - integration.smoke.test_quota.TestQuota.test_06_quota > - integration.smoke.test_quota.TestQuota.test_07_quota > - > integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv > ategw_static_routes > - > integration.smoke.test_privategw_acl.TestPrivateGwACL.test_02_vpc_priv > ategw_static_routes > - > integration.smoke.test_privategw_acl.TestPrivateGwACL.test_03_rvpc_pri > vategw_static_routes > - integration.smoke.test_iso.TestISO.test_07_list_default_iso > > ---------------------------------------------------------------------- > --end----------------------- > >
