[
https://issues.apache.org/jira/browse/IMPALA-13739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltán Borók-Nagy updated IMPALA-13739:
---------------------------------------
Fix Version/s: Impala 5.0.0
> Refactor file descriptor objects for Iceberg tables
> ---------------------------------------------------
>
> Key: IMPALA-13739
> URL: https://issues.apache.org/jira/browse/IMPALA-13739
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Zoltán Borók-Nagy
> Assignee: Gabor Kaszab
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 5.0.0
>
>
> FileDescriptor is currently used by both HdfsTable and IcebergTable. It has
> two flatbuffers internally:
> {noformat}
> // Internal representation of a file descriptor using a FlatBuffer.
> private final FbFileDesc fbFileDescriptor_;
> // Internal representation of additional file metadata, e.g. Iceberg
> metadata.
> private final FbFileMetadata fbFileMetadata_;{noformat}
> fbFileMetadata_ is only for Iceberg tables, this means FileDescriptor is
> larger than needed when it is part of legacy Hive tables.
> We should introduce a new IcebergFileDescriptor class and only it should have
> a member for Iceberg metadata. And this member could be FbIcebergMetadata
> directly (instead of FbFileMetadata).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]