[
https://issues.apache.org/jira/browse/IMPALA-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18014661#comment-18014661
]
ASF subversion and git services commented on IMPALA-14261:
----------------------------------------------------------
Commit 19c12e0e06b3d94e370710825b5a71348b6abec3 in impala's branch
refs/heads/master from Daniel Becker
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=19c12e0e0 ]
IMPALA-14261: Take 'impala.computeStatsSnapshotId' into account when deciding
between Puffin and HMS stats
Since IMPALA-13609, Impala writes snapshot information for each column
on COMPUTE STATS for Iceberg tables (see there for why it is useful),
but this information has so far been ignored.
After this change, snapshot information is used when deciding which of
HMS and Puffin NDV stats should be used (i.e. which is more recent).
This test also modifies the
IcebergUtil.ComputeStatsSnapshotPropertyConverter class: previously
Iceberg fieldIds were stored as Long, but now they are stored as
Integer, in accordance with the Iceberg spec.
Documentation:
- updated the docs about Puffin stats in docs/topics/impala_iceberg.xml
Testing:
- modified existing tests to fit the new decision mechanism
Change-Id: I95a5b152dd504e94dea368a107d412e33f67930c
Reviewed-on: http://gerrit.cloudera.org:8080/23251
Reviewed-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Daniel Becker <[email protected]>
Tested-by: Daniel Becker <[email protected]>
> Take 'impala.computeStatsSnapshotId' into account when deciding between
> Puffin and HMS stats
> --------------------------------------------------------------------------------------------
>
> Key: IMPALA-14261
> URL: https://issues.apache.org/jira/browse/IMPALA-14261
> Project: IMPALA
> Issue Type: Improvement
> Components: Frontend
> Reporter: Daniel Becker
> Assignee: Daniel Becker
> Priority: Major
> Labels: impala, impala-iceberg, impala-iceberg-active-backlog
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
