Re: hive1.2.1 on spark 1.5.2

2016-01-26 Thread Sofia Panagiotidi
Using the prebuilt versions from the apache website for both Hive and Spark > On 26 Jan 2016, at 14:00, Sofia Panagiotidi > wrote: > > I have also managed to use Hive 1.2.1 with Spark 1.4.1 > > >> On 26 Jan 2016, at 10:20, Mich Talebzadeh > <mailto:m...@per

Re: hive1.2.1 on spark 1.5.2

2016-01-26 Thread Sofia Panagiotidi
I have also managed to use Hive 1.2.1 with Spark 1.4.1 > On 26 Jan 2016, at 10:20, Mich Talebzadeh wrote: > > As far as I have worked this one out Hive 1.2.1 works on Spark 1.3.1 for now. > This means Hive will use spark engine. > > > set spark.home=/usr/lib/spark-1.3.1-bin-hadoop2.6; > se

Re: Unable to start container using hive on spark

2016-01-12 Thread Sofia
Hi Todd I just made a simple execution with 'yarn-client’ and it seems to work with my hive and spark. I have been using the pre-built version of Spark 1.4.1, so in my case I did not have to build it myself. <http://www.taiger.com/> SOFIA PANAGIOTIDI www.taiger.com <http://

Re: Unable to start container using hive on spark

2016-01-11 Thread Sofia
issue exactly as at some point I faced the same, but I hope this might help. Cheers > On 11 Jan 2016, at 11:39, Todd wrote: > > > Thank you, Sofia. > > From the log, looks it is java.lang.AbstractMethodError that leads to the job > failure. > I am using Hive 1.2.

Re: Unable to start container using hive on spark

2016-01-11 Thread Sofia
Check log files to see the exact error. Alternatively run hive like this, to get the exact error hive --hiveconf hive.root.logger=INFO,console There is a good chance that you are encountering problems between the Hive and Spark versions and installation. See https://cwiki.apache.org/confluenc

Re: troubleshooting: "unread block data' error

2015-12-28 Thread Sofia Panagiotidi
/hive-common-1.2.1.jar:/usr/local/hive-1.2.1/lib/hive-exec-1.2.1.jar Cheers Sofia > On 19 Nov 2015, at 21:54, Xuefu Zhang wrote: > > Are you able to run queries that are not touching HBase? This problem were > seen before but fixed. > > On Tue, Nov 17, 2015

Re: Executor getting killed when running Hive on Spark

2015-12-24 Thread Sofia
mr or tez as an execution engine? > > Does a normal Spark job without Hive work? > > On 24 Dec 2015, at 17:25, Sofia <mailto:sofia.panagiot...@taiger.com>> wrote: > >> Hello and happy holiday to those who are already enjoying it! >> >> >> I a

Executor getting killed when running Hive on Spark

2015-12-24 Thread Sofia
g killed? Have I built Spark wrongly? I have tried building it in several different ways and I keep failing. I must admit I am confused with the information I find online on how to use/build Spark on Hive and which version goes with what. Can I download a pre-built version of Spark that would be suitable with my existing Hadoop 2.7.1 and my Hive 1.2.1? This error has been baffling me for weeks.. More than grateful for any help! Sofia

Re: troubleshooting: "unread block data' error

2015-12-23 Thread Sofia
; Are you able to run queries that are not touching HBase? This problem were > seen before but fixed. > > On Tue, Nov 17, 2015 at 3:37 AM, Sofia <mailto:sofia.panagiot...@taiger.com>> wrote: > Hello, > > I have configured Hive to work Spark. > > I have been tryi

HBase client task rejected from java.util.concurrent.ThreadPoolExecutor

2015-12-18 Thread Sofia
just can’t seem to make it work and I am not even sure if this error indicates a Hive or HBase problem. I am using Hive 1.2.1, a HiveServer2, HBase 1.1.2 and the default settings for Hive apart from the hive.execution.engine which is spark on local mode. Thanks! Sofia

HBase client task rejected from java.util.concurrent.ThreadPoolExecutor

2015-12-18 Thread Sofia
just can’t seem to make it work and I am not even sure if this error indicates a Hive or HBase problem. I am using Hive 1.2.1, a HiveServer2, HBase 1.1.2 and the default settings for Hive apart from the hive.execution.engine which is spark on local mode. Thanks! Sofia

Re: Hive version with Spark

2015-11-30 Thread Sofia
so stated. It is the > responsibility of the recipient to ensure that this email is virus free, > therefore neither Peridale Ltd, its subsidiaries nor their employees accept > any responsibility. > > From: Jimmy Xiang [mailto:jxi...@cloudera.com] > Sent: 30 November 2015 17:28 > To

Re: Hive version with Spark

2015-11-28 Thread Sofia Panagiotidi
f you are not the intended > recipient, you should destroy it immediately. Any information in this message > shall not be understood as given or endorsed by Peridale Technology Ltd, its > subsidiaries or their employees, unless expressly so stated. It is the > responsibility of the recipi

Hive version with Spark

2015-11-18 Thread Sofia
trying: mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0 -Phive -Phive-1.2.1 -Phive-thriftserver -DskipTests clean package I get : The requested profile "hive-1.2.1" could not be activated because it does not exist. Thank you Sofia

troubleshooting: "unread block data' error

2015-11-17 Thread Sofia
tImpl:at java.lang.Thread.run(Thread.java:745) I read something about the guava.jar missing but I am not sure how to fix it. I am using Spark 1.4.1, HBase 1.1.2 and Hive 1.2.1. Any help more than appreciated. Sofia