RE: Problem with getting start of Hive on Spark

Hi Mich, I set hive execution engine as Spark. Link Qian From: m...@peridale.co.uk To: user@hive.apache.org Subject: RE: Problem with getting start of Hive on Spark Date: Mon, 30 Nov 2015 16:15:31 + To clarify are you running Hive and using Spark as the execution engine (as opposed to defau

Spark 1.5.2 + Hive 1.0.0 in Amazon EMR 4.2.0

Hi, I get this error when trying to write Spark DataFrame to Hive Table Stored as TextFile sqlContext.sql('INSERT OVERWRITE TABLE analytics.client_view_stock *(hive table)* SELECT * FROM client_view_stock'*(spark temp table)*') Error: 15/11/30 21:40:14 INFO latency: StatusCode=[404], Exception

Re: [VOTE] Hive 2.0 release plan

Hive 2.0 will not be 100% backwards compatible with 1.x. The following JIRA link shows JIRAs already committed to 2.0 that break compatibility: https://issues.apache.org/jira/issues/?jql=project%20%3D%20HIVE%20AND%20fixVersion%20%3D%202.0.0%20AND%20%22Hadoop%20Flags%22%20%3D%20%22Incompatible%20

Re: [VOTE] Hive 2.0 release plan

So far there’s no plan for Hive 1.3. If someone from committer (PMC? I don’t recall) volunteers they can do the release, should not be difficult, although there are some JIRAs that would need backporting I think (I marked them with target version recently). In fact 2.0 branch creation is delaye

Re: UPDATE RE: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes (beeline - hive server 2)

Hi, I remember encountering a similar problem that was caused by an old mysql client driver. You can try and upgrade your mysql connector. Daniel On Mon, Nov 30, 2015 at 8:12 PM, Timothy Garza < timothy.ga...@collinsongroup.com> wrote: > We’ve been playing with the MySQL Global Settings: (Hive m

RE: UPDATE RE: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes (beeline - hive server 2)

Hi, I don’t this issue with hive server connecting to our Oracle metastore. Have you checked the errorlog of your MySQL? HTH, Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/file

UPDATE RE: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes (beeline - hive server 2)

We’ve been playing with the MySQL Global Settings: (Hive metastore) mysql> set global innodb_large_prefix = ON; (<-- this was set to OFF previously) …and now the ERROR is thus: Specified key was too long; max key length is 3072 bytes So it’s still ‘failing’ (but the HDFS operation itself succe

Re: Hive version with Spark

This has escaped my attention. It would be a good idea to add it maybe to the Hive use page with Spark? On 30 Nov 2015, at 18:42, Mich Talebzadeh wrote: > Hi, > > We have discussed this few times in this forum. > > Kindly refer to topic “Answers to recent questions on Hive on Spark” > >

RE: Hive version with Spark

Hi, We have discussed this few times in this forum. Kindly refer to topic “Answers to recent questions on Hive on Spark” I tried Spark 1.3. 1.3.1. 1.4 and 1.5.2 and neither work with Hive on Spark as execution engine. I ran this one today and it failed in the same familiar place

Re: Hive version with Spark

Hi Sofia, For Hive 1.2.1, you should not use Spark 1.5. There are some incompatible interface change in Spark 1.5. Have you tried Hive 1.2.1 with Spark 1.3.1? As Udit pointed out, you can follow the instruction on https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started

Re: Re: [VOTE] Hive 2.0 release plan

Agreed, any plans for Hive 1.3? Will Hive 2.0 be a breaking release for those running 1.x? On Sun, Nov 15, 2015 at 7:07 PM, Wangwenli wrote: > Good News, *Any release plan for hive 1.3* ??? > > -- > Wangwenli > > > *From:* Gopal Vijayaraghavan > *Date:* 2015-1

RE: Problem with getting start of Hive on Spark

To clarify are you running Hive and using Spark as the execution engine (as opposed to default Hive execution engine MapReduce)? Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15

Problem with getting start of Hive on Spark

Hello, Following the Hive wiki page, https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started, I got a several fails that execute HQL based on Spark engine with yarn. I have hadoop-2.6.2, yarn-2.6.2 and Spark-1.5.2. The fails got either spark-1.5.2-hadoop2.6 distributio

RE: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes

Weirdly I’m experiencing exactly the same issue when trying to populate a Hive Table using INSERT OVERWRITE TABLE. We’re recently upgraded from Hive 0.13 to 1.2.1. NB. The Hive Table populates but the map-reduce returns an error code. I have run the hive Schema Tool: schematool -dbType mysql -

RE: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes

Weirdly I’m experiencing exactly the same issue when trying to populate a Hive Table using INSERT OVERWRITE TABLE. We’re recently upgraded from Hive 0.13 to 1.2.1. NB. The Hive Table populates but the map-reduce returns an error code. I have run the hive Schema Tool: schematool -dbType mysql -

Re: Hotels.com

Sorry about the spam. Seems like my account was hacked this morning. On Mon, Nov 30, 2015 at 10:46 AM, Elliot West wrote: > This looks like a phishing attempt. Please do no open it. > > On 30 November 2015 at 10:32, @Sanjiv Singh > wrote: > >> >> >> Regards >> Sanjiv Singh >> Mob : +091 9

Re: Hotels.com

This looks like a phishing attempt. Please do no open it. On 30 November 2015 at 10:32, @Sanjiv Singh wrote: > > > Regards > Sanjiv Singh > Mob : +091 9990-447-339 > > On Mon, Nov 30, 2015 at 1:16 PM, Amrit Jangid > wrote: > >> ?? >> >> On Mon, Nov 30, 2015 at 11:56 AM, Roshini Johri >>

Re: Hotels.com

Regards Sanjiv Singh Mob : +091 9990-447-339 On Mon, Nov 30, 2015 at 1:16 PM, Amrit Jangid wrote: > ?? > > On Mon, Nov 30, 2015 at 11:56 AM, Roshini Johri > wrote: > >> [image: Inline image 2] >> >> Roshini Johri >> >> [image: Inline image 1] >> >> >>

com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Specified key was too long; max key length is 767 bytes

hi guys, when I am trying to use mysql to manager hive metastore，I got a problem like below: [root@master hive]# hive Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-1.1.1.jar!/hive-log4j.properties SLF4J: Class path contains multiple SLF4J bindings.

Test framework for hive

Hello All, I want to test a hive storage handler, What is the best way to do so? Any test framework that I can use to test with all of hive versions. I also have another question: Can anybody point me to hive test/s that supports all hive data types and then insertion and retrieval of data on to