Re: Work on Spark engine for Hive

So I only know that latest CDH released version does have Hive (based on 1.2) on Spark 1.6 , though admittedly have not tested Hive 2.0 branch on that. So I would recommend for you try the latest 1.6-based Spark assembly from CDH (the version that we test) to rule out possibility of building it di

Re: Work on Spark engine for Hive

The fundamental problem seems to be the spark-assembly-n.n.n-hadoopn.n..jar libraries that are incompatible and cause issues. For example Hive does not work with existing Spark 1.6.1 binaries, In other words if you set hive.execution.engine in the following $HIVE_HOME/cong/hive-site.xml hive.e

Re: Work on Spark engine for Hive

Yes, that is a good goal we will have to do eventually. I was not aware that it is not working to be honest. Can you let us know what is broken on Hive 2 on Spark 1.6.1? Preferably via filing a JIRA on HIVE side? On Fri, Apr 8, 2016 at 7:47 AM, Mich Talebzadeh wrote: > This is a different thi

Re: Work on Spark engine for Hive

This is a different thing. the question is when will Hive 2 be able to run on Spark 1.6.1 installed binaries as execution engine. Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw