Stamatis Zampetakis created HIVE-25684:
------------------------------------------

             Summary: Many (~16K) skipped tests in 
TestGenericUDFInitializeOnCompareUDF
                 Key: HIVE-25684
                 URL: https://issues.apache.org/jira/browse/HIVE-25684
             Project: Hive
          Issue Type: Task
          Components: Testing Infrastructure
    Affects Versions: 4.0.0
            Reporter: Stamatis Zampetakis
            Assignee: Stamatis Zampetakis
         Attachments: skipped_tests.png

TestGenericUDFInitializeOnCompareUDF is a parameterized test leading to 24K 
possible test combinations. From those only 7K are actually run and the rest 
(~16K) are skipped. 

{noformat}
mvn test -Dtest=TestGenericUDFInitializeOnCompareUDF
...
[WARNING] Tests run: 24300, Failures: 0, Errors: 0, Skipped: 16452, Time 
elapsed: 7.098 s - in 
org.apache.hadoop.hive.ql.udf.generic.TestGenericUDFInitializeOnCompareUDF
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 7848, Failures: 0, Errors: 0, Skipped: 0
{noformat}

This generates a lot of noise in Jenkins CI, where many tests appear as 
skipped, and it may make people believe it is a problem (side effect of their 
changes).  Moreover, we know in advance which tests are skipped and why so 
instead of generating invalid parameter combinations we could simply remove 
those combinations altogether.




--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to