rangareddy commented on issue #15769: URL: https://github.com/apache/hudi/issues/15769#issuecomment-4878217622
This issue was reviewed as part of the JIRA-migrated backlog triage. Findings: this describes an incomplete feature, not a bug. Currently supported: SCD2 can be achieved today via a custom DeltaStreamer transformer that splits each input batch into insert/active-update/overwritten records and a complex record key that includes an active/version field (see the runbook linked in the JIRA comment). Pending: first-class SCD2 support (a dedicated payload or built-in transformer) so users don't have to hand-roll the transformer. Keeping open. Will be scoped into a future feature-completion effort. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
