[
https://issues.apache.org/jira/browse/HUDI-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-3217:
----------------------------------
Description:
This is Phase 2 of what outlined in HUDI-3081
The goals are
* Avoid tight coupling with particular record representation on the Read Path
(currently Avro) and enable
*
** Common record handling API for combining records (Merge API)
*
** Avoiding unnecessary serde by abstracting away standardized Record access
routines (getting key, merging, etc)
*** Behind the interface we'd rely on engine-specific representation to carry
the payload (`InternalRow` for Spark, `ArrayWritable` for Hive, etc)
was:
This is Phase 2 of what outlined in HUDI-3081
The goal is
* Avoid tight coupling with particular record representation on the Read Path
(currently Avro) and enable
** Common record handling API for combining records (Merge API)
** Avoiding unnecessary serde by abstracting away standardized Record access
routines (getting key, merging, etc)
*** Behind the interface we'd rely on engine-specific representation to carry
the payload (`InternalRow` for Spark, `ArrayWritable` for Hive, etc)
> [Phase 2] Revisit Record Payload handling
> -----------------------------------------
>
> Key: HUDI-3217
> URL: https://issues.apache.org/jira/browse/HUDI-3217
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Alexey Kudinkin
> Assignee: Alexey Kudinkin
> Priority: Blocker
> Fix For: 0.11.0
>
>
> This is Phase 2 of what outlined in HUDI-3081
> The goals are
> * Avoid tight coupling with particular record representation on the Read
> Path (currently Avro) and enable
> *
> ** Common record handling API for combining records (Merge API)
> *
> ** Avoiding unnecessary serde by abstracting away standardized Record access
> routines (getting key, merging, etc)
> *** Behind the interface we'd rely on engine-specific representation to
> carry the payload (`InternalRow` for Spark, `ArrayWritable` for Hive, etc)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
