Andreas Neumann created SPARK-57375:
---------------------------------------
Summary: AutoCdcScd1FullRefreshSuite is flaky
Key: SPARK-57375
URL: https://issues.apache.org/jira/browse/SPARK-57375
Project: Spark
Issue Type: Bug
Components: Declarative Pipelines
Affects Versions: 4.2.0, 4.3.0
Reporter: Andreas Neumann
This test suite sometimes fails in CI.
Root cause: All AutoCDC test suites share the same static
SharedTablesInMemoryRowLevelOperationTableCatalog.sharedTables map and use
identical namespace ns1. When SBT runs suites in parallel (same JVM,
parallelExecution = true), one suite's operations can impact other suites'
queries, and afterEach calling reset() (which clears the entire map) can
destroy tables that another concurrent suite is using.
The fix is to make each suite use a unique namespace, and clearing only that
namespace in afterEach().
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
