, Oct 7, 2014 at 6:16 PM, Cheng Lian wrote:
> So it seems that the classpath issue has been resolved. The instantiation
> failure should be related to your hive-site.xml. Would you mind to create a
> public gist for your hive-site.xml?
>
>
> On 10/8/14 4:34 AM, Li HM wrote:
Thanks Cheng.
Here is the error message after a fresh build.
$ mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.5.0 -Phive -DskipTests
clean package
[INFO]
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM ...
Thanks for the replied.
Please refer to my another post entitled "How to make ./bin/spark-sql
work with hive". It has all the error/exceptions I am getting.
If I understand you correctly, I can build the package with
mvn -Phive,hadoop-2.4 -Dhadoop.version=2.5.0 clean package
This is what I actua
01)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1893)
... 57 more
On Fri, Oct 3, 2014 at 10:09 PM, Li HM wrote:
> If I change it to
>
> org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProvider
>
> The error becomes:
> Exception in thread "mai
a:2004)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 11 more
On Fri, Oct 3, 2014 at 10:05 PM, Li HM wrote:
> It won't work with org.apache.hadoop.hive.ql.security.
> HadoopDefaultAuthenticator.
>
> Just wonder how and why it works with you guys.
>
> Here is the new e
>
>
>
> hive.security.authenticator.manager
>
>
>
>
> org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator
>
>
>
>
>
> - Edwin
>
> On Fri, Oct 3, 2014 at 4:25 PM, Li HM wrote:
>
>> If I don't have that jar, I am getting the following
core.jar? That is probably causing the
> issues.
>
> On Fri, Oct 3, 2014 at 3:03 PM, Li HM wrote:
>
>> This is my SPARK_CLASSPATH after cleanup
>> SPARK_CLASSPATH=/home/test/lib/hcatalog-core.jar:$SPARK_CLASSPATH
>>
>> now use mydb works.
>>
>>
Armbrust
wrote:
> Often java.lang.NoSuchMethodError means that you have more than one
> version of a library on your classpath, in this case it looks like hive.
>
> On Thu, Oct 2, 2014 at 8:44 PM, Li HM wrote:
>
>> I have rebuild package with -Phive
>> Copied hive-site.xml to con
I have rebuild package with -Phive
Copied hive-site.xml to conf (I am using hive-0.12)
When I run ./bin/spark-sql, I get java.lang.NoSuchMethodError for every
command.
What am I missing here?
Could somebody share what would be the right procedure to make it work?
java.lang.NoSuchMethodError:
or
