Re: Using JAR files located on HDFS for SerDe

2017-04-18 Thread Jason Dere
There is an existing Jira to be able to specify the necessary JARs in the CREATE TABLE command, but this is not in yet - HIVE-9252 From: Jörn Franke Sent: Wednesday, April 12, 2017 8:04 AM To: user@hive.apache.or

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread hernan saab
Edward,Consider putting together a project at the time of documentation. This way, users at least know all the variables that you use to prove a particular configuration works.Use GIT, its a simple revision control tool that developers at the Hive community should get confortable with. It should

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread Edward Capriolo
On Tue, Apr 18, 2017 at 3:32 PM, hernan saab wrote: > The effort of configuring an apache big data system by hand for your > particular needs is equivalent to herding rattlesnakes and cats into one > small room. > The documentation is poor and most of the time the community developers > don't rea

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread hernan saab
The effort of configuring an apache big data system by hand for your particular needs is equivalent to herding rattlesnakes and cats into one small room.The documentation is poor and most of the time the community developers don't really feel like helping you.Use Ambari or any other orchestratio

Re: Error with Hive 2.1.1 and Spark 2.1

2017-04-18 Thread Vihang Karajgaonkar
+sergio Thank you for pointing this out. Based on what I see here https://github.com/apache/hive/blob/branch-2.1/pom.xml#L179 Hive 2.1 supports Sparks 1.6. There is a JIRA to add support for Spark 2.0 https://issues.apache.org/jira/browse/HIVE-14029 but that is available from Hive 2.2.x I have cr