Re: Two results are inconsistent when i use Hive on Spark

2016-01-27 Thread Xuefu Zhang
Hi Jone, Did you meant you get different results from time to time? If so, could you run "explain query" multiple times to see if there is any difference. Also, could you try without map-join hint? Without dataset, it's hard to reproduce the problem. Thus, it's great if you can provide DML, and t

Re: Two results are inconsistent when i use Hive on Spark

2016-01-26 Thread Jone Zhang
*Some properties on hive-site.xml is* hive.ignore.mapjoin.hint false hive.auto.convert.join true hive.auto.convert.join.noconditionaltask true *If more information is required,please let us know.* *Thanks.* 2016-01-27 15:20 GMT+08:00 Jone Zhang : > *I have run a query many times, there w

Two results are inconsistent when i use Hive on Spark

2016-01-26 Thread Jone Zhang
*I have run a query many times, there will be two results without regular.* *One is 36834699 and other is 18464706.* *The query is * set spark.yarn.queue=soft.high; set hive.execution.engine=spark; select /*+mapjoin(t3,t4,t5)*/ count(1) from ( select coalesce(t11.qua,t12.qua,t13.qua) qua