Peter Vary created HIVE-25673:
---------------------------------

             Summary: Column pruning fix for MR tasks
                 Key: HIVE-25673
                 URL: https://issues.apache.org/jira/browse/HIVE-25673
             Project: Hive
          Issue Type: Bug
            Reporter: Peter Vary
            Assignee: Peter Vary


When running join tests for Iceberg tables then we got the following exception:
{code}
Caused by: java.lang.RuntimeException: Map operator initialization failed
        at 
org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:131)
        ... 23 more
Caused by: java.lang.RuntimeException: cannot find field val from 
[org.apache.iceberg.mr.hive.serde.objectinspector.IcebergRecordObjectInspector$IcebergRecordStructField@45f29d]
        at 
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardStructFieldRef(ObjectInspectorUtils.java:550)
        at 
org.apache.iceberg.mr.hive.serde.objectinspector.IcebergRecordObjectInspector.getStructFieldRef(IcebergRecordObjectInspector.java:70)
        at 
org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.initialize(ExprNodeColumnEvaluator.java:56)
        at 
org.apache.hadoop.hive.ql.exec.Operator.initEvaluators(Operator.java:1073)
        at 
org.apache.hadoop.hive.ql.exec.Operator.initEvaluatorsAndReturnStruct(Operator.java:1099)
        at 
org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:74)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:360)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:549)
        at 
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:503)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:369)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:549)
        at 
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:503)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:369)
        at 
org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:505)
        at 
org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:110)
        ... 23 more
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to