David Arthur created KAFKA-18444: ------------------------------------ Summary: Test catalog not always capturing everything Key: KAFKA-18444 URL: https://issues.apache.org/jira/browse/KAFKA-18444 Project: Kafka Issue Type: Bug Components: build Reporter: David Arthur
Looking at the history of the test-catalog branch, it seems that something is causing partial results occasionally. This can cause tests to be incorrectly selected as quarantined. Here is a recent example {code:java} commit 2ab969a3d85d613a988cbfce1d56ea0920115639 (test-catalog) Author: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Date: Thu Dec 19 18:53:08 2024 +0000 Update test catalog data for GHA workflow run 12415446571 Commit: https://github.com/apache/kafka/commit/b31aa651156fbc961fbb8460604393fef1c09185 GitHub Run: https://github.com/apache/kafka/actions/runs/12415446571 test-catalog/clients/tests.yaml | 1 + test-catalog/generator/tests.yaml | 116 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ test-catalog/streams/tests.yaml | 1 + test-catalog/test-common/test-common-runtime/tests.yaml | 12 +++++++++++ 4 files changed, 130 insertions(+)commit 83cd514fb816c3aa5c35ee471696afafbb5e13e8 Author: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Date: Thu Dec 19 17:32:38 2024 +0000 Update test catalog data for GHA workflow run 12415578652 Commit: https://github.com/apache/kafka/commit/35bb79953109f541e0733d5dac71bd55d8dc9210 GitHub Run: https://github.com/apache/kafka/actions/runs/12415578652 test-catalog/generator/tests.yaml | 116 ------------------------------------------------------------------------------------------------------ test-catalog/streams/tests.yaml | 1 - test-catalog/test-common/test-common-runtime/tests.yaml | 12 ----------- 3 files changed, 129 deletions(-) {code} we see in workflow run 12415578652 that several tests are removed from the catalog, but re-added in the next workflow. -- This message was sent by Atlassian Jira (v8.20.10#820010)