Gopal V created HIVE-12208: ------------------------------ Summary: Vectorized JOIN NPE on dynamically partitioned hash-join Key: HIVE-12208 URL: https://issues.apache.org/jira/browse/HIVE-12208 Project: Hive Issue Type: Bug Components: Vectorization Affects Versions: 2.0.0 Reporter: Gopal V Assignee: Jitendra Nath Pandey
TPC-DS Q19 with reducer vectorized join optimizations {code} set hive.optimize.dynamic.partition.hashjoin=true; set hive.vectorized.execution.reduce.enabled=true; set hive.mapjoin.hybridgrace.hashtable=false; select i_brand_id brand_id, i_brand brand, i_manufact_id, i_manufact, sum(ss_ext_sales_price) ext_price from date_dim, store_sales, item,customer,customer_address,store where date_dim.d_date_sk = store_sales.ss_sold_date_sk and store_sales.ss_item_sk = item.i_item_sk and i_manager_id=7 and d_moy=11 and d_year=1999 and store_sales.ss_customer_sk = customer.c_customer_sk and customer.c_current_addr_sk = customer_address.ca_address_sk and substr(ca_zip,1,5) <> substr(s_zip,1,5) and store_sales.ss_store_sk = store.s_store_sk group by i_brand ,i_brand_id ,i_manufact_id ,i_manufact order by ext_price desc ,i_brand ,i_brand_id ,i_manufact_id ,i_manufact {code} possibly a trivial plan setup issue, since the NPE is pretty much immediate. {code} Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:368) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:852) at org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinGenerateResultOperator.forwardBigTableBatch(VectorMapJoinGenerateResultOperator.java:603) at org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:362) ... 19 more Caused by: java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerGenerateResultOperator.commonSetup(VectorMapJoinInnerGenerateResultOperator.java:112) at org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:96) ... 22 more {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)