Ziqi Liu created SPARK-53435:
--------------------------------
Summary: race condition in CachedRDDBuilder
Key: SPARK-53435
URL: https://issues.apache.org/jira/browse/SPARK-53435
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 4.0.0
Reporter: Ziqi Liu
There is race condition between `CachedRDDBuilder.cachedColumnBuffers` and
`CachedRDDBuilder.clearCache`: when they interleave each other,
`cachedColumnBuffers` might return a `nullptr`.
This looks like a day-1 bug introduced from
https://github.com/apache/spark/commit/20ca208bcda6f22fe7d9fb54144de435b4237536#diff-4068fce361a50e3d32af2ba2d4231905f500e7b2da9f46d5ddd99b758c30fd43
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
