Zoltán Borók-Nagy created IMPALA-13739:
------------------------------------------
Summary: Refactor file descriptor objects for Iceberg tables
Key: IMPALA-13739
URL: https://issues.apache.org/jira/browse/IMPALA-13739
Project: IMPALA
Issue Type: Improvement
Components: Catalog
Reporter: Zoltán Borók-Nagy
Assignee: Gabor Kaszab
FileDescriptor is currently used by both HdfsTable and IcebergTable. It has two
flatbuffers internally:
{noformat}
// Internal representation of a file descriptor using a FlatBuffer.
private final FbFileDesc fbFileDescriptor_;
// Internal representation of additional file metadata, e.g. Iceberg
metadata.
private final FbFileMetadata fbFileMetadata_;{noformat}
fbFileMetadata_ is only for Iceberg tables, this means FileDescriptor is larger
than needed when it is part of legacy Hive tables.
We should introduce a new IcebergFileDescriptor class and only it should have a
member for Iceberg metadata. And this member could be FbIcebergMetadata
directly (instead of FbFileMetadata).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
