[
https://issues.apache.org/jira/browse/HIVE-12208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-12208:
---------------------------
Summary: Vectorized JOIN NPE on dynamically partitioned hash-join +
map-join (was: Vectorized JOIN NPE on dynamically partitioned hash-join)
> Vectorized JOIN NPE on dynamically partitioned hash-join + map-join
> -------------------------------------------------------------------
>
> Key: HIVE-12208
> URL: https://issues.apache.org/jira/browse/HIVE-12208
> Project: Hive
> Issue Type: Bug
> Components: Vectorization
> Affects Versions: 2.0.0
> Reporter: Gopal V
>
> TPC-DS Q19 with reducer vectorized join optimizations
> {code}
> set hive.optimize.dynamic.partition.hashjoin=true;
> set hive.vectorized.execution.reduce.enabled=true;
> set hive.mapjoin.hybridgrace.hashtable=false;
> select i_brand_id brand_id, i_brand brand, i_manufact_id, i_manufact,
> sum(ss_ext_sales_price) ext_price
> from date_dim, store_sales, item,customer,customer_address,store
> where date_dim.d_date_sk = store_sales.ss_sold_date_sk
> and store_sales.ss_item_sk = item.i_item_sk
> and i_manager_id=7
> and d_moy=11
> and d_year=1999
> and store_sales.ss_customer_sk = customer.c_customer_sk
> and customer.c_current_addr_sk = customer_address.ca_address_sk
> and substr(ca_zip,1,5) <> substr(s_zip,1,5)
> and store_sales.ss_store_sk = store.s_store_sk
> group by i_brand
> ,i_brand_id
> ,i_manufact_id
> ,i_manufact
> order by ext_price desc
> ,i_brand
> ,i_brand_id
> ,i_manufact_id
> ,i_manufact
> {code}
> possibly a trivial plan setup issue, since the NPE is pretty much immediate.
> {code}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:368)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:852)
> at
> org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinGenerateResultOperator.forwardBigTableBatch(VectorMapJoinGenerateResultOperator.java:603)
> at
> org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:362)
> ... 19 more
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerGenerateResultOperator.commonSetup(VectorMapJoinInnerGenerateResultOperator.java:112)
> at
> org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinInnerLongOperator.process(VectorMapJoinInnerLongOperator.java:96)
> ... 22 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
