anishshri-db commented on code in PR #54277:
URL: https://github.com/apache/spark/pull/54277#discussion_r2829722843
##########
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/v2/state/StateDataSourceReadSuite.scala:
##########
@@ -1501,3 +1502,169 @@ abstract class StateDataSourceReadSuite extends
StateDataSourceTestBase with Ass
}
}
}
+
+/**
+ * Test suite that verifies the state data source reader does not create empty
state
+ * directories when reading state for all stateful operators.
+ *
+ * The reader does not create metadata directories (no mkdirs on the schema
metadata path).
+ * This is important for
+ * Unity Catalog environments where creating directories requires WRITE FILES
permission,
Review Comment:
nit: lets remove this line the comment
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
