Thanks Muthu for pointing out the issue.
However unfortunately I am back to the same old issue while accessing the
external table. I am getting the following exception again, there wasn’t any
change in the environment.
I tried all the cleanup but still no luck :-( Here are the steps I tried
1. Removed the other jar for es-hadoop 2.1.x completely from the server
2. Updated the hive-site.xml as below, but didn't work
<property>
<name>hive.aux.jars.path</name>
<value>/apps/sas/elasticsearch-hadoop-2.0.2/dist/elasticsearch-hadoop-2.0.2.jar</value>
<description>A comma separated list (with no spaces) of the jar
files</description>
</property>
3. Added the jar file in the hiveconf as below, still the same issue
hive --hiveconf
hive.aux.jars.path=/apps/sas/elasticsearch-hadoop-2.0.2/dist/elasticsearch-hadoop-2.0.2.jar
4. Tried adding the jar file in the hive session, still didn't work
add jar
/apps/sas/elasticsearch-hadoop-2.0.2/dist/elasticsearch-hadoop-2.0.2.jar;
Thanks
- Atul
ERROR:
2014-11-26 23:09:22,069 ERROR [main]: exec.DDLTask (DDLTask.java:execute(478))
- java.lang.IllegalAccessError: tried to access class
org.elasticsearch.hadoop.hive.HiveUtils from class
org.elasticsearch.hadoop.hive.EsSerDe
at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:339)
at
org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:288)
at
org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:281)
at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:631)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:593)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4189)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:281)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1503)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1270)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1088)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:911)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:901)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
2014-11-26 23:09:22,069 ERROR [main]: ql.Driver
(SessionState.java:printError(545)) - FAILED: Execution Error, return code 1
from org.apache.hadoop.hive.ql.exec.DDLTask. tried to access class
org.elasticsearch.hadoop.hive.HiveUtils from class
org.elasticsearch.hadoop.hive.EsSerDe
From: Muthu Pandi [mailto:muthu1...@gmail.com]
Sent: Thursday, November 27, 2014 9:08 PM
To: user@hive.apache.org
Subject: Re: Can't integrate Elasticsearch with Hive
Hi Atul
Check your typo "tblproperties('es.resources' = 'employee/address') " need
to be "es.resource" as it rightly indicated in the Error.
Regards
Muthupandi.K
[Image removed by sender.] Think before you print.
On Fri, Nov 28, 2014 at 3:43 AM, Edward Capriolo
<edlinuxg...@gmail.com<mailto:edlinuxg...@gmail.com>> wrote:
Because the elastic search storage handler is not part of hive you might be
able to find more help asking the author of the storage handler. From the
errors you are reporting it likely does not work and not tested against this
version of hive.
