[
https://issues.apache.org/jira/browse/IMPALA-14080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016507#comment-18016507
]
ASF subversion and git services commented on IMPALA-14080:
----------------------------------------------------------
Commit 048b5689fd6adbe7f7e7fda0f04bd95c6f510a45 in impala's branch
refs/heads/master from Steve Carlin
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=048b5689f ]
IMPALA-14080: Support LocalFsTable table types in Calcite planner.
IMPALA-13947 changes the use_local_catalog default to true. This causes
failure for when the use_calcite_planner query option is set to true.
The Calcite planner was only handling HdfsTable table types. It will
now handle LocalFsTable table types as well.
Currently, if table num rows is missing from table, Calcite planner will
load all partitions to estimate by iterating all partitions. This is
inefficent in local catalog mode and ideally should happen later after
partition prunning. Follow up work is needed to improve this.
Testing:
Reenable local catalog mode in
TestCalcitePlanner.test_calcite_frontend
TestWorkloadManagementSQLDetailsCalcite.test_tpcds_8_decimal
Co-authored-by: Riza Suminto
Change-Id: Ic855779aa64d11b7a8b19dd261c0164e65604e44
Reviewed-on: http://gerrit.cloudera.org:8080/23341
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Calcite Planner: Support queries against tables in the local catalog mode
> -------------------------------------------------------------------------
>
> Key: IMPALA-14080
> URL: https://issues.apache.org/jira/browse/IMPALA-14080
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Fang-Yu Rao
> Assignee: Fang-Yu Rao
> Priority: Major
>
> Currently the Calcite planner in Impala does not support queries against
> tables in the local catalog mode. Hence, we should support this. We describe
> how to reproduce the issue in the following.
> {code:java}
> // Start the Impala with flag '--use_calcite_planner=true' in the local
> catalog mode on the command line.
> ./bin/start-impala-cluster.py --use_calcite_planner=true \
> '--impalad_args=--use_local_catalog' \
> '--catalogd_args=--catalog_topic_mode=minimal'
> // Within impala-shell, submit a query against a table to the Impala server
> [localhost:21050] default> select id from functional.alltypes;
> Query: select id from functional.alltypes
> Query submitted at: 2025-05-15 15:37:10 (Coordinator: http://fangyu:25000)
> ERROR: Query d741cf9401b3135b:d002bdbe00000000 failed:
> UnsupportedFeatureException: Table functional.alltypes has unsupported type
> LocalFsTable. The Calcite planner only supports HdfsTable's and View's.
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
