[
https://issues.apache.org/jira/browse/IMPALA-15361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aleksandr Efimov reassigned IMPALA-15361:
-----------------------------------------
Assignee: Aleksandr Efimov
> TIMESTAMP column stats are written to a Hive 4 metastore and never read back
> ----------------------------------------------------------------------------
>
> Key: IMPALA-15361
> URL: https://issues.apache.org/jira/browse/IMPALA-15361
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Reporter: Aleksandr Efimov
> Assignee: Aleksandr Efimov
> Priority: Major
>
> Impala 5.0.0-SNAPSHOT (build e8d42f753d) with an Apache Hive 4.0.0 metastore.
> After COMPUTE STATS, REFRESH rejects statistics for TIMESTAMP columns as
> incompatible and SHOW COLUMN STATS reports NDV as -1. In 78 minutes, catalogd
> logged 212 such warnings for 119 columns in 58 tables, all TIMESTAMP.
> The cause is confirmed. Hive 4 reconstructs statistics according to the
> column type and returns TIMESTAMP as timestampStats, field 8 of
> ColumnStatisticsData, regardless of which engine wrote them. Impala writes
> longStats, but ColumnStats.update() does not read the timestampStats
> representation returned by Hive 4.
> The failure was reproduced end to end with Hive 4.0.0. The same Hive behavior
> is present in 4.2.1, and the compatible reader path was checked with the Hive
> 4.0.1 and 4.2.1 APIs.
> The reader should accept both longStats and timestampStats while keeping
> compatibility with older Hive APIs. Low and high values remain unset.
> Filed under IMPALA-13647.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
