[
https://issues.apache.org/jira/browse/SPARK-58261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andreas Neumann updated SPARK-58261:
------------------------------------
Description:
To support SCD Type 2, SQL must allow:
- STORED AS SCD TYPE (1|2)
- TRACK HISTORY ON (<column names> | * EXCEPT <column names>)
STORED AS SCD TYPE is optional and defaults to 1.
TRACK HISTORY is only allowed only for SCD2.
Also, TRACK HISTORY must be the last clause in the AutoCdc command.
was:
To support SCD Type 2, SQL must allow:
- STORED AS SCD TYPE 2
- TRACK HISTORY ON (<column names> | * EXCEPT <column names>)
TRACK HISTORY is only allowed only for SCD2.
Also, TRACK HISTORY must be the last clause in the AutoCdc command.
> Support for SCD Type 2 in SQL syntax
> ------------------------------------
>
> Key: SPARK-58261
> URL: https://issues.apache.org/jira/browse/SPARK-58261
> Project: Spark
> Issue Type: Sub-task
> Components: Declarative Pipelines
> Affects Versions: 4.3.0
> Reporter: Andreas Neumann
> Priority: Major
>
> To support SCD Type 2, SQL must allow:
> - STORED AS SCD TYPE (1|2)
> - TRACK HISTORY ON (<column names> | * EXCEPT <column names>)
> STORED AS SCD TYPE is optional and defaults to 1.
> TRACK HISTORY is only allowed only for SCD2.
> Also, TRACK HISTORY must be the last clause in the AutoCdc command.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
