[
https://issues.apache.org/jira/browse/IMPALA-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on IMPALA-14952 started by Peter Rozsa.
--------------------------------------------
> IndexOutOfBoundsException in Iceberg Insert if lineage tracking is enabled
> --------------------------------------------------------------------------
>
> Key: IMPALA-14952
> URL: https://issues.apache.org/jira/browse/IMPALA-14952
> Project: IMPALA
> Issue Type: Bug
> Reporter: Peter Rozsa
> Assignee: Peter Rozsa
> Priority: Major
>
> IndexOutOfBoundsException is thrown on INSERT to Iceberg v3 tables if lineage
> tracking is enabled for Impala, either by --lineage_event_log_dir, or if a
> lineage hook is installed.
> The issue stems from the newly added hidden columns and the column label
> index calculation.
> Error:
> java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: toIndex = 3
> at
> org.apache.impala.service.Frontend.getTExecRequestWithFallback(Frontend.java:2459)
> at
> org.apache.impala.service.Frontend.createExecRequest(Frontend.java:2126)
> at
> org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:175)
> Caused by: java.lang.IndexOutOfBoundsException: toIndex = 3
> at
> java.base/java.util.AbstractList.subListRangeCheck(AbstractList.java:507)
> at java.base/java.util.ArrayList.subList(ArrayList.java:1108)
> at
> org.apache.impala.planner.HdfsTableSink.collectExprs(HdfsTableSink.java:392)
> at
> org.apache.impala.planner.Planner.createPlanFragments(Planner.java:281)
> at org.apache.impala.planner.Planner.createPlans(Planner.java:315)
> at
> org.apache.impala.service.Frontend.createExecRequest(Frontend.java:2064)
> at
> org.apache.impala.service.Frontend.getPlannedExecRequest(Frontend.java:3424)
> at
> org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:3198)
> at
> org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2590)
> at
> org.apache.impala.service.Frontend.getTExecRequestWithFallback(Frontend.java:2436)
> ... 2 more
>
> Repro:
> {code:java}
> create table a(id int) stored as iceberg tblproperties('format-version'='3');
> insert into a values(1); {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
