Andreas Neumann created SPARK-58247:
---------------------------------------
Summary: Support for SCD Type 2 in Python and Spark Connect APIs
Key: SPARK-58247
URL: https://issues.apache.org/jira/browse/SPARK-58247
Project: Spark
Issue Type: Sub-task
Components: Declarative Pipelines
Affects Versions: 4.3.0
Reporter: Andreas Neumann
Implement the APIs all the way to the graph registration. This will allow
registering an SCD type 2 flow in the graph, including validation. This does
not include work to handle SCD Type 2 in the graph analysis or graph execution
(implemented separately), and the user will still get a "not supported" error
during those phases until they are implemented.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
