Gopal V created HIVE-12208:
------------------------------

             Summary: Vectorized JOIN NPE on dynamically partitioned hash-join
                 Key: HIVE-12208
                 URL: https://issues.apache.org/jira/browse/HIVE-12208
             Project: Hive
          Issue Type: Bug
          Components: Vectorization
    Affects Versions: 2.0.0
            Reporter: Gopal V
            Assignee: Jitendra Nath Pandey


TPC-DS Q19 with reducer vectorized join optimizations

{code}
set hive.optimize.dynamic.partition.hashjoin=true;
set hive.vectorized.execution.reduce.enabled=true;
set hive.mapjoin.hybridgrace.hashtable=false;

select  i_brand_id brand_id, i_brand brand, i_manufact_id, i_manufact,
        sum(ss_ext_sales_price) ext_price
 from date_dim, store_sales, item,customer,customer_address,store
 where date_dim.d_date_sk = store_sales.ss_sold_date_sk
   and store_sales.ss_item_sk = item.i_item_sk
   and i_manager_id=7
   and d_moy=11
   and d_year=1999
   and store_sales.ss_customer_sk = customer.c_customer_sk 
   and customer.c_current_addr_sk = customer_address.ca_address_sk
   and substr(ca_zip,1,5) <> substr(s_zip,1,5) 
   and store_sales.ss_store_sk = store.s_store_sk 
 group by i_brand
      ,i_brand_id
      ,i_manufact_id
      ,i_manufact
 order by ext_price desc
         ,i_brand
         ,i_brand_id
         ,i_manufact_id
         ,i_manufact
{code}

possibly a trivial plan setup issue, since the NPE is pretty much immediate.

{code}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
java.lang.NullPointerException
        at 
org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:368)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:852)
        at 
org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinGenerateResultOperator.forwardBigTableBatch(VectorMapJoinGenerateResultOperator.java:603)
        at 
org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:362)
        ... 19 more
Caused by: java.lang.NullPointerException
        at 
org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerGenerateResultOperator.commonSetup(VectorMapJoinInnerGenerateResultOperator.java:112)
        at 
org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:96)
        ... 22 more
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to