[
https://issues.apache.org/jira/browse/CLOUDSTACK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Santhosh Kumar Edukulla updated CLOUDSTACK-4971:
------------------------------------------------
Description:
1, Currently test scripts are running despite the test setup has issues. EX: In
one of the test scenario, where ldap server was down, test suite or test cases
depending upon them were still running.
2, Ideally, the setup( test module setup ) should check for these dependencies
before running the test script and exit wherever possible with proper log and
reporting.
3, We may not be able to cover all setup issues under setup class of test
module or feature test class, but the purpose of setup is also to check for
its existence and dependencies. Scripts depending upon particular server
conditions, should have a proper setup verifying the server existence before
proceeding further.
4, I believe running test cases when setup is down is also not idealistic.
5. Purpose is to reduce script errors vs failures due to product bugs.
6. Logging this bug to track the setup issue cases or script failures.
was:
1, Currently test scripts are running despite the test setup has issues. EX: In
one of the test scenario, where ldap server was down, test suite or test cases
depending upon them was still running.
2, Ideally, the setup should check for these dependencies before running the
test script and exit wherever possible with proper log and reporting .
3, We may not be able to cover all setup issues, but the purpose of setup is
also to check for its existence and dependencies. Scripts depending upon
particular server conditions, should have a proper setup verifying the server
existence before proceeding further.
4, I believe running test cases when setup is down is also not idealistic.
5. Purpose is to reduce script errors vs failures due to product bugs.
6. Logging this bug to track the setup issue cases or script failures.
> Verifying proper Setup Issues EX:Server Down, other prerequisites for test
> setup to minimize test script failures.
> ------------------------------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-4971
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4971
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Environment: Regression,Smoke tests etc.
> Reporter: Santhosh Kumar Edukulla
> Assignee: sadhu suresh
>
> 1, Currently test scripts are running despite the test setup has issues. EX:
> In one of the test scenario, where ldap server was down, test suite or test
> cases depending upon them were still running.
> 2, Ideally, the setup( test module setup ) should check for these
> dependencies before running the test script and exit wherever possible with
> proper log and reporting.
> 3, We may not be able to cover all setup issues under setup class of test
> module or feature test class, but the purpose of setup is also to check for
> its existence and dependencies. Scripts depending upon particular server
> conditions, should have a proper setup verifying the server existence before
> proceeding further.
> 4, I believe running test cases when setup is down is also not idealistic.
> 5. Purpose is to reduce script errors vs failures due to product bugs.
> 6. Logging this bug to track the setup issue cases or script failures.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
