[ 
https://issues.apache.org/jira/browse/CLOUDSTACK-9317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15933300#comment-15933300
 ] 

ASF GitHub Bot commented on CLOUDSTACK-9317:
--------------------------------------------

Github user cloudmonger commented on the issue:

    https://github.com/apache/cloudstack/pull/1908
  
    ### ACS CI BVT Run
     **Sumarry:**
     Build Number 5
     Hypervisor xenserver
     NetworkType Advanced
     Passed=464
     Failed=341
     Skipped=53
    
    _Link to logs Folder (search by build_no):_ 
https://www.dropbox.com/sh/yj3wnzbceo9uef2/AAB6u-Iap-xztdm6jHX9SjPja?dl=0
    
    
    **Failed tests:**
    * test_dhcp_dns_offload.py
    
     * ContextSuite context=TestDeployVMs>:setup Failing since 2 runs
    
    * test_affinity_groups_projects.py
    
     * test_01_deploy_vm_anti_affinity_group Failing since 2 runs
    
     * test_02_deploy_vm_anti_affinity_group_fail_on_not_enough_hosts Failing 
since 2 runs
    
     * test_01_list_aff_grps_for_vm Failing since 3 runs
    
     * test_02_list_multiple_aff_grps_for_vm Failing since 3 runs
    
     * test_07_list_all_vms_in_aff_grp Failing since 2 runs
    
     * test_01_update_aff_grp_by_ids Failed
    
    * test_ps_domain_limits.py
    
     * test_04_create_template_snapshot Failing since 2 runs
    
    * test_VirtualRouter_alerts.py
    
     * test_01_VRServiceFailureAlerting Failed
    
    * test_ss_domain_limits.py
    
     * test_04_create_template_delete_account Failing since 3 runs
    
     * test_04_create_template_delete_account Failing since 4 runs
    
     * test_01_multiple_domains_secondary_storage_limits Failing since 3 runs
    
     * test_02_multiple_domains_secondary_storage_counts Failing since 2 runs
    
    * test_deploy_vm_userdata_multi_nic.py
    
     * test_deployvm_multinic Failing since 2 runs
    
    * test_vpn_service.py
    
     * test_01_VPN_service Failing since 2 runs
    
    * test_organization_states.py
    
     * ContextSuite context=TestOrganizationStates>:setup Failing since 2 runs
    
    * test_escalations_snapshots.py
    
     * ContextSuite context=TestSnapshots>:setup Failing since 2 runs
    
    * test_haproxy.py
    
     * test_01_create_sticky_policy_default_values Failed
    
     * test_02_create_sticky_policy_custom_values Failed
    
     * test_03_supported_policies_by_network Failed
    
     * test_04_delete_lb_rule Failed
    
     * test_05_error_alerts_after_create Failed
    
     * test_06_release_ip Failed
    
     * test_07_delete_account Failed
    
     * test_08_create_policy_router_stopped Failed
    
     * test_09_create_policy_router_destroy Failed
    
     * test_10_create_policy_enable_disable_vpn Failed
    
     * test_11_invalid_params Failed
    
    * test_dynamic_compute_offering.py
    
     * test_max_account_cpus_scale_VM_1_ADMIN_ACCOUNT Failed
    
     * test_max_account_cpus_scale_VM_2_USER_ACCOUNT Failed
    
     * test_max_account_memory_scale_VM_1_ADMIN_ACCOUNT Failing since 2 runs
    
     * test_max_account_memory_scale_VM_2_USER_ACCOUNT Failing since 2 runs
    
     * test_deploy_VM_with_affinity_group_1_ADMIN_ACCOUNT Failing since 2 runs
    
     * test_deploy_VM_with_affinity_group_2_USER_ACCOUNT Failing since 2 runs
    
     * ContextSuite context=TestDynamicServiceOffering>:setup Failing since 2 
runs
    
     * test_change_so_running_vm_dynamic_to_dynamic_1_ADMIN_ACCOUNT Failing 
since 2 runs
    
     * test_change_so_running_vm_dynamic_to_dynamic_2_USER_ACCOUNT Failing 
since 2 runs
    
     * test_change_so_running_vm_dynamic_to_static_1_ADMIN_ACCOUNT Failing 
since 2 runs
    
     * test_change_so_running_vm_dynamic_to_static_2_USER_ACCOUNT Failing since 
2 runs
    
     * test_change_so_running_vm_static_to_dynamic_1_ADMIN_ACCOUNT Failing 
since 2 runs
    
     * test_change_so_running_vm_static_to_dynamic_2_USER_ACCOUNT Failing since 
2 runs
    
     * test_change_so_running_vm_static_to_static_1_ADMIN_ACCOUNT Failing since 
2 runs
    
     * test_change_so_running_vm_static_to_static_2_USER_ACCOUNT Failing since 
2 runs
    
     * test_change_so_stopped_vm_dynamic_to_dynamic_1_ADMIN_ACCOUNT Failing 
since 2 runs
    
     * test_change_so_stopped_vm_dynamic_to_dynamic_2_USER_ACCOUNT Failing 
since 2 runs
    
     * test_change_so_stopped_vm_dynamic_to_static_1_ADMIN_ACCOUNT Failing 
since 2 runs
    
     * test_change_so_stopped_vm_dynamic_to_static_2_USER_ACCOUNT Failing since 
2 runs
    
     * test_change_so_stopped_vm_static_to_dynamic_1_ADMIN_ACCOUNT Failing 
since 2 runs
    
     * test_change_so_stopped_vm_static_to_dynamic_2_USER_ACCOUNT Failing since 
2 runs
    
     * test_change_so_stopped_vm_static_to_static_1_ADMIN_ACCOUNT Failing since 
2 runs
    
     * test_change_so_stopped_vm_static_to_static_2_USER_ACCOUNT Failed
    
    * test_ps_resource_limits_volume.py
    
     * test_attach_volume_exceeding_primary_limits Failing since 2 runs
    
    * test_vpc.py
    
     * test_07_restart_network_vm_running Failing since 2 runs
    
     * test_08_delete_vpc Failing since 2 runs
    
     * test_11_deploy_vm_wo_network_netdomain Failing since 2 runs
    
     * test_13_deploy_vm_with_vpc_netdomain Failing since 2 runs
    
     * test_14_deploy_vm_1 Failing since 2 runs
    
     * test_15_deploy_vm_2 Failing since 2 runs
    
     * test_16_deploy_vm_for_user_by_admin Failing since 2 runs
    
     * test_21_deploy_vm_with_gateway_ip Failing since 2 runs
    
     * test_22_vpn_customer_gw_with_hostname Failing since 2 runs
    
    * test_non_contiguous_vlan.py
    
     * test_01_add_non_contiguous_ranges Failing since 2 runs
    
     * test_05_remove_used_range Failed
    
    * test_project_usage.py
    
     * ContextSuite context=TestLBRuleUsage>:setup Failing since 3 runs
    
     * ContextSuite context=TestNatRuleUsage>:setup Failing since 3 runs
    
     * ContextSuite context=TestPublicIPUsage>:setup Failing since 3 runs
    
     * ContextSuite context=TestSnapshotUsage>:setup Failing since 3 runs
    
     * ContextSuite context=TestVmUsage>:setup Failing since 3 runs
    
     * ContextSuite context=TestVolumeUsage>:setup Failing since 3 runs
    
     * ContextSuite context=TestVpnUsage>:setup Failing since 3 runs
    
    * test_ps_max_limits.py
    
     * test_01_deploy_vm_domain_limit_reached Failed
    
     * test_02_deploy_vm_account_limit_reached Failing since 5 runs
    
     * test_03_deploy_vm_project_limit_reached Failed
    
    * test_project_resources.py
    
     * test_07_associate_public_ip Failing since 2 runs
    
    * test_vpc_network_staticnatrule.py
    
     * test_01_VPC_StaticNatRuleCreateStoppedState Failing since 2 runs
    
     * test_02_VPC_CreateStaticNatRule Failed
    
     * test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState Failing since 2 
runs
    
     * test_04_VPC_CreateMultipleStaticNatRule Failing since 2 runs
    
     * test_05_network_services_VPC_DeleteAllPF Failing since 2 runs
    
     * test_06_network_services_VPC_DeleteAllMultiplePF Failing since 2 runs
    
    * test_redundant_router_services.py
    
     * test_enableVPNOverRvR Failing since 2 runs
    
    * test_resource_limits.py
    
     * test_01_vm_per_account Failing since 2 runs
    
     * test_02_publicip_per_account Failing since 2 runs
    
     * test_03_snapshots_per_account Failing since 2 runs
    
     * test_04_volumes_per_account Failing since 2 runs
    
     * test_05_templates_per_account Failing since 2 runs
    
     * test_01_publicip_per_domain Failed
    
     * test_01_vm_per_domain Failed
    
     * test_03_snapshots_per_domain Failed
    
     * test_04_volumes_per_domain Failed
    
     * test_05_templates_per_domain Failed
    
    * test_escalations_vpncustomergateways.py
    
     * test_01_list_vpncustomergateways_pagination Failing since 2 runs
    
     * test_02_update_vpncustomergateways Failing since 2 runs
    
    * test_snapshots_improvement.py
    
     * test_01_concurrent_snapshots_live_migrate Failed
    
     * test_02_stop_vm_concurrent_snapshots Failed
    
     * test_03_concurrent_snapshots_create_template Failed
    
     * test_04_concurrent_snapshots_create_volume Failed
    
     * test_01_snapshot_on_rootVolume Failed
    
    * test_multiple_public_interfaces.py
    
     * ContextSuite context=TestIptables>:setup Failed
    
     * ContextSuite context=TestPortForwarding>:setup Failing since 9 runs
    
     * ContextSuite context=TestRouting>:setup Failing since 2 runs
    
     * ContextSuite context=TestStaticNat>:setup Failing since 2 runs
    
     * test_network_services_VPC_CreatePF Failing since 3 runs
    
     * test_network_services_VPC_CreatePF Failing since 4 runs
    
    * test_vpn_users.py
    
     * test_01_VPN_user_limit Failed
    
     * test_02_use_vpn_port Failed
    
     * test_03_enable_vpn_use_port Failed
    
     * test_04_add_new_users Failed
    
     * test_05_add_duplicate_user Failed
    
     * test_06_add_VPN_user_global_admin Failed
    
     * test_07_add_VPN_user_domain_admin Failed
    
     * test_08_add_TCP_PF_Rule_In_VPN Failed
    
    * test_cpu_project_limits.py
    
     * test_01_project_counts_start_stop_instance Failing since 2 runs
    
     * test_02_project_counts_migrate_instance Failing since 2 runs
    
     * test_03_project_counts_delete_instance Failing since 2 runs
    
    * test_routers.py
    
     * ContextSuite context=TestRouterServices>:setup Failing since 11 runs
    
     * ContextSuite context=TestRouterStopCreateFW>:setup Failed
    
     * ContextSuite context=TestRouterStopCreateLB>:setup Failed
    
     * ContextSuite context=TestRouterStopCreatePF>:setup Failed
    
    * test_overcommit.py
    
     * test_01_cluster_settings Failing since 2 runs
    
     * test_02_Overcommit_factor Failing since 2 runs
    
     * test_03_cluste_capacity_check Failing since 2 runs
    
     * test_04_zone_capacity_check Failing since 2 runs
    
    * test_custom_hostname.py
    
     * test_01_custom_hostname_instancename_false Failing since 2 runs
    
    * test_snapshots.py
    
     * test_01_createVM_snapshotTemplate Failing since 2 runs
    
     * ContextSuite context=TestSnapshotEvents>:setup Failing since 2 runs
    
     * test_01_volume_from_snapshot Failing since 2 runs
    
     * test_02_snapshot_data_disk Failing since 2 runs
    
     * test_03_snapshot_detachedDisk Failing since 2 runs
    
     * test_04_delete_snapshot Failing since 2 runs
    
     * test_07_template_from_snapshot Failing since 2 runs
    
    * test_egress_fw_rules.py
    
     * test_01_1_egress_fr1 Failing since 2 runs
    
     * test_01_2_egress_fr1 Failing since 2 runs
    
     * test_01_egress_fr1 Failing since 2 runs
    
     * test_02_1_egress_fr2 Failing since 2 runs
    
     * test_02_2_egress_fr2 Failing since 2 runs
    
     * test_02_egress_fr2 Failing since 2 runs
    
     * test_03_1_egress_fr3 Failing since 2 runs
    
     * test_03_egress_fr3 Failing since 2 runs
    
     * test_04_1_egress_fr4 Failing since 2 runs
    
     * test_04_egress_fr4 Failing since 2 runs
    
     * test_06_1_egress_fr6 Failing since 2 runs
    
     * test_06_egress_fr6 Failing since 2 runs
    
     * test_07_1_egress_fr7 Failing since 2 runs
    
     * test_07_egress_fr7 Failing since 2 runs
    
     * test_09_1_egress_fr9 Failing since 2 runs
    
     * test_09_egress_fr9 Failed
    
     * test_10_1_egress_fr10 Failed
    
     * test_10_egress_fr10 Failed
    
     * test_11_1_egress_fr11 Failed
    
     * test_11_egress_fr11 Failed
    
     * test_12_1_egress_fr12 Failed
    
     * test_12_egress_fr12 Failed
    
     * test_13_1_egress_fr13 Failed
    
     * test_13_egress_fr13 Failed
    
    * test_tags.py
    
     * ContextSuite context=TestResourceTags>:setup Failed
    
    * test_redundant_router_cleanups.py
    
     * test_network_gc Failed
    
     * test_restart_network_with_destroyed_masterVR Failing since 2 runs
    
     * test_restart_ntwk_no_cleanup Failed
    
     * test_restart_ntwk_with_cleanup Failed
    
    * test_ss_max_limits.py
    
     * test_01_deploy_vm_domain_limit_reached Failing since 2 runs
    
     * test_02_deploy_vm_account_limit_reached Failing since 6 runs
    
     * test_03_deploy_vm_project_limit_reached Failing since 2 runs
    
    * test_ss_project_limits.py
    
     * test_01_register_template_with_project Failing since 2 runs
    
    * test_deploy_vm_userdata_reg.py
    
     * test_deployvm_userdata_post Failed
    
    * test_memory_limits.py
    
     * test_01_stop_start_instance Failing since 1 runs
    
     * test_02_migrate_instance Failing since 1 runs
    
     * test_03_delete_instance Failed
    
     * test_01_stop_start_instance Failing since 2 runs
    
     * test_02_migrate_instance Failing since 2 runs
    
     * test_03_delete_instance Failing since 2 runs
    
     * test_04_deploy_multiple_vm Failing since 2 runs
    
    * test_vpc_network_pfrules.py
    
     * test_01_network_services_VPC_StopCreatePF Failing since 2 runs
    
     * test_02_network_services_VPC_CreatePF Failing since 2 runs
    
     * test_03_network_services_VPC_StopCreateMultiplePF Failing since 2 runs
    
     * test_04_network_services_VPC_CreateMultiplePF Failing since 2 runs
    
     * test_05_network_services_VPC_StopDeletePF Failing since 2 runs
    
     * test_06_network_services_VPC_DeletePF Failing since 2 runs
    
     * test_07_network_services_VPC_StopDeleteAllPF Failing since 2 runs
    
     * test_08_network_services_VPC_DeleteAllPF Failing since 2 runs
    
     * test_09_network_services_VPC_StopDeleteAllMultiplePF Failing since 2 runs
    
     * test_10_network_services_VPC_DeleteAllMultiplePF Failing since 2 runs
    
    * test_ip_reservation.py
    
     * test_reservation_after_router_restart Failed
    
     * test_vm_create_after_reservation Failing since 3 runs
    
     * test_vm_create_outside_cidr_after_reservation Failing since 3 runs
    
     * test_ip_reservation_in_multiple_networks_same_account Failing since 2 
runs
    
     * test_nat_rules_1_nat_rule Failing since 2 runs
    
     * test_nat_rules_2_static_nat_rule Failing since 2 runs
    
     * test_update_cidr_multiple_vms_not_all_inclusive Failing since 2 runs
    
     * test_update_cidr_single_vm_not_inclusive Failing since 2 runs
    
     * test_vm_create_after_reservation Failing since 4 runs
    
     * test_vm_create_outside_cidr_after_reservation Failing since 4 runs
    
     * test_restart_network_with_cleanup_1_True Failing since 2 runs
    
     * test_restart_network_with_cleanup_2_False Failed
    
     * test_destroy_recreate_router Failed
    
     * test_reservation_after_router_restart Failing since 2 runs
    
     * test_update_network_guestvmcidr_1_existingVmInclusive Failed
    
     * test_update_network_guestvmcidr_2_existingVmExclusive Failed
    
    * test_vpc_vms_deployment.py
    
     * test_01_deploy_vms_in_network Failing since 2 runs
    
     * test_02_deploy_vms_delete_network Failing since 2 runs
    
     * test_03_deploy_vms_delete_add_network Failing since 2 runs
    
     * test_04_deploy_vms_delete_add_network_noLb Failing since 2 runs
    
     * test_05_create_network_max_limit Failing since 2 runs
    
     * test_06_delete_network_vm_running Failing since 2 runs
    
     * test_07_delete_network_with_rules Failing since 2 runs
    
    * test_vpc_network.py
    
     * ContextSuite context=TestVPCNetworkGc>:setup Failing since 2 runs
    
    * test_mm_project_limits.py
    
     * test_01_project_vmlifecycle_start_stop_instance Failing since 2 runs
    
     * test_02_project_vmlifecycle_migrate_instance Failing since 2 runs
    
     * test_03_project_vmlifecycle_delete_instance Failing since 2 runs
    
    * test_escalations_instances.py
    
     * test_13_attach_detach_iso Failing since 2 runs
    
     * test_14_vm_snapshot_pagination Failing since 2 runs
    
     * test_15_revert_vm_to_snapshot Failing since 2 runs
    
     * test_16_list_vm_volumes_pagination Failing since 2 runs
    
     * test_18_stopped_vm_change_service Failing since 2 runs
    
     * test_19_create_reset_vm_sshkey Failing since 2 runs
    
     * test_20_update_vm_displayname_group Failing since 2 runs
    
     * test_21_restore_vm Failing since 2 runs
    
     * test_22_deploy_vm_multiple_networks Failing since 2 runs
    
     * test_24_deploy_vm_with_static_ip_ES1662 Failing since 2 runs
    
     * test_25_ip_reallocation_ES1377 Failing since 2 runs
    
     * test_27_VM_restore_ES3467 Failing since 2 runs
    
     * test_28_VM_restore_ES3467 Failing since 2 runs
    
     * test_01_list_instances_pagination Failing since 2 runs
    
     * test_02_list_Running_vm Failing since 2 runs
    
     * test_03_list_Stopped_vm Failing since 2 runs
    
     * test_04_list_Destroyed_vm Failing since 2 runs
    
     * test_05_list_vm_by_id Failing since 2 runs
    
     * test_06_list_vm_by_name Failing since 2 runs
    
     * test_07_list_vm_by_name_state Failing since 2 runs
    
     * test_10_list_vm_by_zone_name_state Failing since 2 runs
    
     * test_11_register_reset_vm_sshkey Failing since 2 runs
    
     * test_12_running_vm_change_service Failing since 2 runs
    
     * test_13_vm_nics Failing since 2 runs
    
    * test_acl_isolatednetwork.py
    
     * ContextSuite context=TestIsolatedNetwork>:setup Failing since 2 runs
    
    * test_cpu_domain_limits.py
    
     * test_01_multiple_core_vm_start_stop_instance Failing since 2 runs
    
     * test_02_multiple_core_vm_migrate_instance Failing since 2 runs
    
     * test_03_multiple_core_vm_delete_instance Failing since 2 runs
    
     * test_04_deploy_multiple_vm_with_multiple_core Failing since 2 runs
    
     * test_01_multiple_child_domains Failing since 3 runs
    
    * test_escalations_networks.py
    
     * test_03_list_vpc_pagination Failing since 2 runs
    
     * test_04_create_vpc_with_networkdomain Failing since 2 runs
    
     * test_06_create_network_in_vpc Failing since 2 runs
    
     * test_10_list_networks_in_vpc Failing since 2 runs
    
     * test_11_update_vpc Failing since 2 runs
    
     * test_12_list_create_delete_networkACL Failing since 2 runs
    
     * test_19_create_list_reset_delete_vpnconnections Failing since 2 runs
    
    * test_storage_motion.py
    
     * ContextSuite context=TestStorageMotion>:setup Failed
    
    * test_accounts.py
    
     * ContextSuite context=TestAddVmToSubDomain>:setup Failing since 2 runs
    
     * test_DeleteDomain Failing since 2 runs
    
     * test_forceDeleteDomain Failing since 2 runs
    
     * test_01_user_remove_VM_running Failing since 2 runs
    
     * ContextSuite context=TestTemplateHierarchy>:setup Failing since 2 runs
    
     * test_LoginApiDomain Failing since 2 runs
    
     * test_LoginApiUuidResponse Failing since 2 runs
    
    * test_escalations_routers.py
    
     * test_01_FTPModulesInVR Failed
    
    * test_ps_limits.py
    
     * test_create_template_snapshot_1_root_domain_admin Failing since 2 runs
    
     * test_create_template_snapshot_2_child_domain_admin Failing since 2 runs
    
    * test_mm_max_limits.py
    
     * test_02_deploy_vm_account_limit_reached Failing since 7 runs
    
     * test_04_deployVm__account_limit_reached Failing since 3 runs
    
    * test_cpu_max_limits.py
    
     * test_02_deploy_vm_account_limit_reached Failing since 8 runs
    
     * test_04_deployVm__account_limit_reached Failing since 4 runs
    
    * test_escalation_listTemplateDomainAdmin.py
    
     * test_listtemplate Failing since 2 runs
    
    * test_projects.py
    
     * test_09_project_suspend Failed
    
     * test_10_project_activation Failed
    
    * test_portable_ip.py
    
     * test_associate_ip_address_services_enable_disable Failing since 2 runs
    
     * test_list_portable_ip_range_non_root_admin Failed
    
    * test_affinity_groups.py
    
     * test_03_delete_aff_grp_with_vms Failing since 2 runs
    
     * test_01_deploy_vm_without_aff_grp Failing since 2 runs
    
     * test_02_deploy_vm_by_aff_grp_name Failing since 2 runs
    
     * test_03_deploy_vm_by_aff_grp_id Failing since 2 runs
    
     * test_04_deploy_vm_anti_affinity_group Failing since 2 runs
    
     * test_05_deploy_vm_by_id Failing since 2 runs
    
     * test_08_deploy_vm_multiple_aff_grps Failing since 2 runs
    
     * test_09_deploy_vm_multiple_aff_grps Failing since 2 runs
    
     * test_01_list_aff_grps_for_vm Failing since 4 runs
    
     * test_02_list_multiple_aff_grps_for_vm Failing since 4 runs
    
     * test_07_list_all_vms_in_aff_grp Failing since 3 runs
    
     * test_01_update_aff_grp_by_ids Failing since 2 runs
    
     * test_02_update_aff_grp_by_names Failing since 2 runs
    
     * test_03_update_aff_grp_for_vm_with_no_aff_grp Failing since 2 runs
    
     * test_05_update_aff_grp_on_running_vm Failing since 2 runs
    
    * test_acl_listvolume.py
    
     * ContextSuite context=TestVolumeList>:setup Failing since 2 runs
    
    * test_mm_domain_limits.py
    
     * test_01_change_service_offering Failing since 2 runs
    
     * test_02_migrate_vm Failing since 2 runs
    
     * test_03_delete_vm Failing since 2 runs
    
     * test_04_deploy_multiple_vm Failing since 3 runs
    
     * test_01_multiple_child_domains Failing since 4 runs
    
    * test_blocker_bugs.py
    
     * ContextSuite context=TestDataPersistency>:setup Failing since 2 runs
    
     * ContextSuite context=TestNATRules>:setup Failing since 2 runs
    
     * ContextSuite context=TestRouterRestart>:setup Failing since 2 runs
    
     * test_01_list_routers_admin Failing since 2 runs
    
     * test_01_create_template Failing since 3 runs
    
    * test_vpc_network_internal_lbrules.py
    
     * test_02_internallb_rules_traffic Failing since 2 runs
    
     * test_03_internallb_rules_vpc_network_restarts_traffic Failing since 2 
runs
    
     * test_04_internallb_appliance_operations_traffic Failing since 2 runs
    
    * test_add_remove_network.py
    
     * ContextSuite context=TestAddNetworkToVirtualMachine>:setup Failing since 
2 runs
    
     * ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup Failing 
since 2 runs
    
     * ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setup Failing 
since 2 runs
    
     * ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setup 
Failing since 2 runs
    
     * ContextSuite context=TestRemoveNetworkFromVirtualMachine>:setup Failing 
since 2 runs
    
     * ContextSuite context=TestUpdateVirtualMachineNIC>:setup Failing since 2 
runs
    
    * test_escalations_ipaddresses.py
    
     * test_11_create_delete_firewallrule Failing since 2 runs
    
    * test_volumes.py
    
     * ContextSuite context=TestAttachDetachVolume>:setup Failed
    
     * ContextSuite context=TestAttachVolume>:setup Failing since 2 runs
    
     * ContextSuite context=TestAttachVolumeISO>:setup Failing since 2 runs
    
     * ContextSuite context=TestMigrateVolume>:setup Failing since 2 runs
    
     * ContextSuite context=TestVolumes>:setup Failing since 13 runs
    
    * test_acl_listsnapshot.py
    
     * ContextSuite context=TestSnapshotList>:setup Failing since 2 runs
    
    * test_stopped_vm.py
    
     * test_deploy_vm_password_enabled Failing since 2 runs
    
    * test_escalations_templates.py
    
     * test_01_list_templates_pagination Failing since 2 runs
    
     * test_02_download_template Failing since 2 runs
    
     * test_03_edit_template_details Failing since 2 runs
    
    * test_ss_limits.py
    
     * test_01_register_template_1_root_domain_admin Failing since 2 runs
    
     * test_01_register_template_2_child_domain_admin Failing since 2 runs
    
     * test_02_create_template_snapshot_1_root_domain_admin Failed
    
     * test_02_create_template_snapshot_2_child_domain_admin Failed
    
    * test_ps_resize_volume.py
    
     * test_01_increase_volume_size_within_account_limit Failed
    
     * test_02_increase_volume_size_above_account_limit Failing since 2 runs
    
     * test_03_increase_volume_size_above_domain_limit Failing since 2 runs
    
    * test_vm_passwdenabled.py
    
     * ContextSuite context=TestVMPasswordEnabled>:setup Failed
    
    * test_usage.py
    
     * ContextSuite context=TestLBRuleUsage>:setup Failing since 4 runs
    
     * ContextSuite context=TestNatRuleUsage>:setup Failing since 4 runs
    
     * ContextSuite context=TestPublicIPUsage>:setup Failing since 4 runs
    
     * ContextSuite context=TestSnapshotUsage>:setup Failing since 4 runs
    
     * ContextSuite context=TestVmUsage>:setup Failing since 4 runs
    
     * ContextSuite context=TestVolumeUsage>:setup Failing since 4 runs
    
     * ContextSuite context=TestVpnUsage>:setup Failing since 4 runs
    
    * test_vpc_vm_life_cycle.py
    
     * test_02_deploy_vm_vpcvr_stopped Failed
    
     * ContextSuite context=TestVMLifeCycleDiffHosts>:setup Failed
    
     * ContextSuite context=TestVMLifeCycleSharedNwVPC>:setup Failed
    
     * ContextSuite context=TestVMLifeCycleStoppedVPCVR>:setup Failed
    
     * ContextSuite context=TestVMLifeCycleVPC>:setup Failed
    
    * test_project_limits.py
    
     * test_03_vm_per_project Failed
    
     * test_04_publicip_per_project Failed
    
     * test_05_snapshots_per_project Failed
    
     * test_06_volumes_per_project Failing since 2 runs
    
     * test_07_templates_per_project Failing since 2 runs
    
    * test_templates.py
    
     * test_01_create_template Failing since 4 runs
    
    * test_assign_vm.py
    
     * test_13_move_across_subdomain_vm_snapshot Failing since 2 runs
    
     * test_15_move_across_subdomain_account_limit Failing since 2 runs
    
     * test_16_move_across_subdomain_volume_and_account_limit Failing since 2 
runs
    
    
    **Skipped tests:**
    test_03_copy_template
    ContextSuite context=TestvGPUWindowsVm>:setup
    ContextSuite context=TestTemplateUsage>:setup
    test_02_create_vpc_from_offering_with_regionlevelvpc_service_capability
    test_03_deploy_vms_in_vpc_with_regionlevelvpc
    test_02_cancel_host_maintenace_with_migration_jobs
    ContextSuite context=TestInstanceNameFlagTrue>:setup
    test_04_deploy_multiple_vm_with_multiple_cpus
    test_05_1_egress_fr5
    test_05_egress_fr5
    test_08_1_egress_fr8
    test_08_egress_fr8
    ContextSuite context=TestAffinityRules>:setup
    ContextSuite context=TestAntiAffinityRules>:setup
    test_02_create_vpc_from_offering_with_distributedrouter_service_capability
    test_03_deploy_vms_in_vpc_with_distributedrouter
    test_04_deploy_multiple_vm
    ContextSuite context=TestProjectCreationNegative>:setup
    ContextSuite context=TestProjectInviteRequiredTrue>:setup
    ContextSuite context=TestProjectInviteTimeout>:setup
    test_RVR_network
    test_01_create_network_2_network_offering_vpcns
    test_02_create_network_fail_2_network_offering_vpcns
    test_04_create_multiple_networks_with_lb_1_network_offering
    test_04_create_multiple_networks_with_lb_2_network_offering_vpcns
    test_06_create_network_with_rvr
    test_09_create_network_shared_nwoff_2_network_offering_vpcns
    test_01_create_network_outside_range_2_network_offering_vpcns
    test_03_create_network_inside_range_2_network_offering_vpcns
    test_04_create_network_overlapping_range_2_network_offering_vpcns
    test_05_create_network_diff_account_2_network_offering_vpcns
    test_02_concurrent_snapshot_global_limit
    test_01_VM_start_stop
    test_02_migrate_vm
    test_03_delete_vm
    test_01_deploy_vm_with_implicit_planner
    test_destroy_recover_vm_1_root_domain_admin
    test_destroy_recover_vm_2_child_domain_admin
    test_04_copy_iso
    test_04_update_aff_grp_remove_all
    test_01_host_ha_with_nfs_storagepool_with_vm
    test_02_host_ha_with_local_storage_and_nfs
    test_03_host_ha_with_only_local_storage
    ContextSuite context=TestTemplates>:setup
    test_09_stop_vm_migrate_vol
    test_04_copy_template
    test_04_copy_template_1_root_domain_admin
    test_04_copy_template_2_child_domain_admin
    test1_attach_volume_ide
    test2_attach_ISO_in_CentOSVM
    ContextSuite context=TestTemplateUsage>:setup
    test_01_addLdapConfiguration
    ContextSuite context=TestTemplates>:setup
    
    **Passed test suits:**
    None
    test_redundant_router_upgrades.py
    test_regions_accounts.py
    test_acl_isolatednetwork_delete.py
    test_invalid_gw_nm.py
    test_vpc_offerings.py
    test_vpc_routers.py
    test_acl_listvm.py
    test_simultaneous_volume_attach.py
    test_update_vm.py
    test_escalations_volumes.py
    test_regions.py
    test_acl_sharednetwork.py
    test_allocation_states.py
    test_snapshot_gc.py
    test_network_offering.py
    None


> Disabling static NAT on many IPs can leave wrong IPs on the router
> ------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-9317
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-9317
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the 
> default.) 
>          Components: Management Server, Virtual Router
>    Affects Versions: 4.7.0, 4.7.1, 4.7.2
>            Reporter: Jeff Hair
>
> The current behavior of enabling or disabling static NAT will call the apply 
> IP associations method in the management server. The method is not 
> thread-safe. If it's called from multiple threads, each thread will load up 
> the list of public IPs in different states (add or revoke)--correct for the 
> thread, but not correct overall. Depending on execution order on the virtual 
> router, the router can end up with public IPs assigned to it that are not 
> supposed to be on it anymore. When another account acquires the same IP, this 
> of course leads to network problems.
> The problem has been in CS since at least 4.2, and likely affects all 
> recently released versions. Affected version is set to 4.7.x because that's 
> what we verified against.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to