Denis Veselovskiy created JENKINS-13821:
-------------------------------------------

             Summary: When test uses DataProvider  it mark in TestLink only by 
last result 
                 Key: JENKINS-13821
                 URL: https://issues.jenkins-ci.org/browse/JENKINS-13821
             Project: Jenkins
          Issue Type: Bug
          Components: testlink, testng
         Environment: win7, Jenkins ver. 1.452, TestLink 1.9.3, Jenkins 
TestLink Plugin 3.1.2   
            Reporter: Denis Veselovskiy
            Assignee: Bruno P. Kinoshita


I have such test

@Test(dataProvider = "validateFieldBase", dataProviderClass = 
CampaignData.class)
    public void validateNameField(String campaignName) {
       ...
    }

and such DataProvider for it

   @DataProvider
    public static Object[][] validateFieldBase() {
        Object[][] word = {
                {"<script language='JavaScript'> alert('Hello') </script>"},
                {"ASDGFFLKLKLKlddvddsghdsh"},
                {"12344557688008853"},
                {":!@#$%^&*()_."},
                {"ASDASDasdas-123123211212&^%&^%"},
        };
        return(word);
    }

And I have test cause in TestLink mapped by Test Result Seeking Strategies  - 
TestNG Method Name.

Problem: test cause in TestLink marks failed or passed by the last DataProvider 
result (in example by value "ASDASDasdas-123123211212&^%&^%") 

Expected result: if all DataProvider values passed than test cause in Testlink 
should mark as passed,
                 if even one DataProvider value is failed than test cause in 
Testlink should mark as failed.

may be its not a bug, but I think it will be a really nice feature.

P.S. : I tried to use successPercentage=100 but it's uncertainly for me when 
and for what it should be used.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.jenkins-ci.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to