Re: Unable to start container using hive on spark

Hi Todd I just made a simple execution with 'yarn-client’ and it seems to work with my hive and spark. I have been using the pre-built version of Spark 1.4.1, so in my case I did not have to build it myself. SOFIA PANAGIOTIDI www.taiger.com

Re:Re: Unable to start container using hive on spark

Hi Sofia, Thank you for the detailed guide. I confirmed that there are compatibility issues between Hive 1.2.1 and Spark 1.5.X. Hive 1.2.1 is by default built against spark 1.3.1 and compatible with spark 1.4.1,but doesn't work with 1.5.X. Basically,I am using somewhat the same configuration a

Re: Unable to start container using hive on spark

From what I have seen you need to use a Spark version that does not contain the Hive jars. (maybe build one as described at the page). Maybe someone can respond to the compatibility issue better than me. However, this is how I managed to make hive work with Spark I had similar issues with the d

Re:Re: Unable to start container using hive on spark

Thank you, Sofia. From the log, looks it is java.lang.AbstractMethodError that leads to the job failure. I am using Hive 1.2.1+Spark 1.5.2, is this a compatibility issue? 16/01/11 17:42:06 [stderr-redir-1]: INFO client.SparkClientImpl: 16/01/11 17:42:06 INFO log.PerfLogger: 16/01/11

Re: Unable to start container using hive on spark

Check log files to see the exact error. Alternatively run hive like this, to get the exact error hive --hiveconf hive.root.logger=INFO,console There is a good chance that you are encountering problems between the Hive and Spark versions and installation. See https://cwiki.apache.org/confluenc

Unable to start container using hive on spark

Hive, I am trying out the Hive on Spark with hive 1.2.1 and spark 1.5.2. Could someone help me on this? Thanks! Following are my steps: 1. build spark 1.5.2 without Hive and Hive Thrift Server. At this point, I can use it to submit application using spark-submit --master yarn-client 2. And t