Re: Hive on Spark for simple hive queries

2014-11-04 Thread Xuefu Zhang
For certain simple queries like your example, Hive doesn't some optimization by execute it locally, which means no jobs are submitted to the cluster (MR or Spark). I'm not sure if there is a way to turn this off, but this is true for all execution engines. Thanks, Xuefu On Tue, Nov 4, 2014 at 8:3

Hive on Spark for simple hive queries

2014-11-04 Thread Prabu Soundar Rajan -X (prabsoun - MINDTREE LIMITED at Cisco)
Hi Team, In spite of setting hive execution engine as Spark, when we try simple hive queries having only mapper phase like (select * from table where column=xyz) - we observe the jobs are not submitted to Spark master. We do not see those jobs in Spark master web UI. But when we try some querie