[ https://issues.apache.org/jira/browse/HUDI-2763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Manoj Govindassamy updated HUDI-2763: ------------------------------------- Summary: Metadata table records key deduplication (was: Avoid persisting redundant key field in the Metadata table record payload) > Metadata table records key deduplication > ---------------------------------------- > > Key: HUDI-2763 > URL: https://issues.apache.org/jira/browse/HUDI-2763 > Project: Apache Hudi > Issue Type: Improvement > Components: Writer Core > Reporter: Manoj Govindassamy > Assignee: Manoj Govindassamy > Priority: Blocker > Labels: pull-request-available > Fix For: 0.11.0 > > > The Metadata record payload has a key field which is the same as the record > key. Since the metadata table on-disk storage is HFile KV format, we are > already persisting the record key in HFile data block as the Key. So, it > would be good to save on the storage cost for the metadata table by avoiding > any redundant key fields. -- This message was sent by Atlassian Jira (v8.20.1#820001)