Peter Rozsa created IMPALA-14952:
------------------------------------
Summary: IndexOutOfBoundsException in Iceberg Insert if lineage
tracking is enabled
Key: IMPALA-14952
URL: https://issues.apache.org/jira/browse/IMPALA-14952
Project: IMPALA
Issue Type: Bug
Reporter: Peter Rozsa
Assignee: Peter Rozsa
IndexOutOfBoundsException is thrown on INSERT to Iceberg v3 tables if lineage
tracking is enabled for Impala, either by --lineage_event_log_dir, or if a
lineage hook is installed.
The issue stems from the newly added hidden columns and the column label index
calculation.
Error:
java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: toIndex = 3
at
org.apache.impala.service.Frontend.getTExecRequestWithFallback(Frontend.java:2459)
at
org.apache.impala.service.Frontend.createExecRequest(Frontend.java:2126)
at
org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:175)
Caused by: java.lang.IndexOutOfBoundsException: toIndex = 3
at
java.base/java.util.AbstractList.subListRangeCheck(AbstractList.java:507)
at java.base/java.util.ArrayList.subList(ArrayList.java:1108)
at
org.apache.impala.planner.HdfsTableSink.collectExprs(HdfsTableSink.java:392)
at
org.apache.impala.planner.Planner.createPlanFragments(Planner.java:281)
at org.apache.impala.planner.Planner.createPlans(Planner.java:315)
at
org.apache.impala.service.Frontend.createExecRequest(Frontend.java:2064)
at
org.apache.impala.service.Frontend.getPlannedExecRequest(Frontend.java:3424)
at
org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:3198)
at
org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2590)
at
org.apache.impala.service.Frontend.getTExecRequestWithFallback(Frontend.java:2436)
... 2 more
Repro:
{code:java}
create table a(id int) stored as iceberg tblproperties('format-version'='3');
insert into a values(1); {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
