[
https://issues.apache.org/jira/browse/IMPALA-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Riza Suminto resolved IMPALA-14437.
-----------------------------------
Fix Version/s: Impala 5.0.0
Target Version: Impala 5.0.0
Resolution: Fixed
> FileMetadataLoader.createFd() regress after IMPALA-14349
> --------------------------------------------------------
>
> Key: IMPALA-14437
> URL: https://issues.apache.org/jira/browse/IMPALA-14437
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Affects Versions: Impala 5.0.0
> Reporter: Riza Suminto
> Assignee: Riza Suminto
> Priority: Major
> Labels: broken-build
> Fix For: Impala 5.0.0
>
>
> IMPALA-14349 caused a regression due to change in
> FileMetadataLoader.createFd(). When default FS is S3, all files is S3 should
> not have any FileBlock. However, after IMPALA-14349, CTAS query that scans
> functional.alltypes table in S3 hit following Preconditions in
> HdfsScanNode.java:
> {code:java}
> if (!fsHasBlocks) {
> Preconditions.checkState(fileDesc.getNumFileBlocks() == 0);{code}
> Following is the snippet from the log.
> {code:java}
> I20250910 07:36:52.709887 63842 Frontend.java:2431]
> 8a47939d765631e1:4821604e00000000] Analyzing query: INSERT into TABLE
> functional_kudu.alltypes
> SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col,
> float_col, double_col, date_string_col, string_col,
> timestamp_col, year, month
> FROM functional.alltypes db: default...I20250910 07:36:52.956176 63842
> jni-util.cc:321] 8a47939d765631e1:4821604e00000000]
> java.lang.IllegalStateException
> at
> com.google.common.base.Preconditions.checkState(Preconditions.java:496)
> at
> org.apache.impala.planner.HdfsScanNode.computeScanRangeLocations(HdfsScanNode.java:1364)
> at org.apache.impala.planner.HdfsScanNode.init(HdfsScanNode.java:444)
> at
> org.apache.impala.planner.SingleNodePlanner.createHdfsScanPlan(SingleNodePlanner.java:1684)
> at
> org.apache.impala.planner.SingleNodePlanner.createScanNode(SingleNodePlanner.java:1906)
> at
> org.apache.impala.planner.SingleNodePlanner.createTableRefNode(SingleNodePlanner.java:2235)
> at
> org.apache.impala.planner.SingleNodePlanner.createTableRefsPlan(SingleNodePlanner.java:937)
> at
> org.apache.impala.planner.SingleNodePlanner.createSelectPlan(SingleNodePlanner.java:752)
> at
> org.apache.impala.planner.SingleNodePlanner.createQueryPlan(SingleNodePlanner.java:284)
> at
> org.apache.impala.planner.SingleNodePlanner.createSingleNodePlan(SingleNodePlanner.java:176)
> at
> org.apache.impala.planner.Planner.createPlanFragments(Planner.java:137)
> at org.apache.impala.planner.Planner.createPlans(Planner.java:312)
> at
> org.apache.impala.service.Frontend.createExecRequest(Frontend.java:2031)
> at
> org.apache.impala.service.Frontend.getPlannedExecRequest(Frontend.java:3356)
> at
> org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:3130)
> at
> org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2538)
> at
> org.apache.impala.service.Frontend.getTExecRequestWithFallback(Frontend.java:2407)
> at
> org.apache.impala.service.Frontend.createExecRequest(Frontend.java:2096)
> at
> org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:176)
> I20250910 07:36:52.956212 63842 status.cc:129]
> 8a47939d765631e1:4821604e00000000] IllegalStateException: null {code}
> This is because, after IMPALA-14349, FileMetadataLoader.createFd() skip
> checking if the originating FileSystem support supportsStorageIds() or not.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
