Hi, I am trying to run some group operations (like max, min, avg, count etc) on Hive table with 300 columns. So, my select query would have more than 1000 columns and more than 4000 characters. The select query is failing. I am facing the below issue.
Diagnostic Messages for this Task: Error: java.lang.RuntimeException: Hive Runtime Error while closing operators at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:217) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs( UserGroupInformation.java:1796) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ArrayIndexOutOfBoundsException: -128 at org.apache.hadoop.hive.ql.exec.GroupByOperator.closeOp( GroupByOperator.java:1084) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:598) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:610) at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:199) ... 8 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang. ArrayIndexOutOfBoundsException: -128 at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush( GroupByOperator.java:1042) at org.apache.hadoop.hive.ql.exec.GroupByOperator.closeOp( GroupByOperator.java:1081) ... 13 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang. ArrayIndexOutOfBoundsException: -128 at org.apache.hadoop.hive.ql.exec.ReduceSinkOperator. processOp(ReduceSinkOperator.java:401) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:815) at org.apache.hadoop.hive.ql.exec.GroupByOperator.forward( GroupByOperator.java:1007) at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush( GroupByOperator.java:1025) ... 14 more Caused by: java.lang.ArrayIndexOutOfBoundsException: -128 at java.util.ArrayList.elementData(ArrayList.java:400) at java.util.ArrayList.get(ArrayList.java:413) at org.apache.hadoop.hive.serde2.binarysortable. BinarySortableSerDe.serialize(BinarySortableSerDe.java:797) at org.apache.hadoop.hive.serde2.binarysortable. BinarySortableSerDe.serialize(BinarySortableSerDe.java:609) at org.apache.hadoop.hive.ql.exec.ReduceSinkOperator. toHiveKey(ReduceSinkOperator.java:508) at org.apache.hadoop.hive.ql.exec.ReduceSinkOperator. processOp(ReduceSinkOperator.java:394) ... 17 more Thanks, Hina
