[
https://issues.apache.org/jira/browse/IMPALA-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18115928#comment-18115928
]
Quanlong Huang commented on IMPALA-13449:
-----------------------------------------
Thanks for sharing the preliminary results!
I think tables like functional.alltypes and tpcds.store_sales are for
correctness testing and not suitable for testing scalibility. They are actually
small tables, e.g. 4MB of mem usage is negligible in a 100GB JVM heap.
In practicse, there are tables with small files issue (e.g. 1M files) or
over-partitioning issue (e.g. 500K partitions). Their actual memory usage could
be larger than 1GB per table but the estimated size is usually much smaller. We
care more about the error rate of estimation on such large tables than on small
tables.
Could you test on some large tables? You can try the steps mentioned here in
IMPALA-14583.
> Improve / Correct the Table Size in Catalog Web UI for External and Iceberg
> Tables
> ----------------------------------------------------------------------------------
>
> Key: IMPALA-13449
> URL: https://issues.apache.org/jira/browse/IMPALA-13449
> Project: IMPALA
> Issue Type: New Feature
> Components: Catalog
> Reporter: Manish Maheshwari
> Assignee: Arnab Karmakar
> Priority: Critical
>
> Improve / Correct the Table Size in Catalog Web UI for External and Iceberg
> Tables. The current size shows tables extremely small and the logic needs to
> be refreshed for Iceberg tables
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
