Eric Marnadi created SPARK-51904:
------------------------------------
Summary: Removing async metadata purging for
OperatorStateMetadataV2
Key: SPARK-51904
URL: https://issues.apache.org/jira/browse/SPARK-51904
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 4.0.0, 4.1.0
Reporter: Eric Marnadi
Currently, we don't want to purge OperatorStateMetadataV2 or StateSchemaV3
files, so we need to remove the relevant call from MicrobatchExecution. The
changes are needed because we cannot purge schema files because these are
necessary until full rewrite is implemented.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
