Hi,
Having some trouble getting hcatloader to work.
My script is this:
A = LOAD 'testTable' USING org.apache.hive.hcatalog.pig.HCatLoader();
DUMP A;
I got it working using PigServer on the node where Hive is running. That
hive-site.xml contains this property:
<property>
<name>hive.metastore.uris</name>
<value>thrift://hadoop:9083</value>
</property>
HiveMetaStore is running at 9083 and I seem to be able to hit it. Things
work.
When I run from a remote location using the same exact code, classpath, and
config, when I try to run against 9083 I get connection refused. I think
that's expected since I don't think HiveMetaStore is meant to be hit
remotely.
I tried changing 9083 to 10000, where HiveServer2 is running. In this case
my request hangs and I see a thrif error in the hive-server2.log (see
below).
I'm guessing this is not the proper way to get pig to make calls against
HiveServer2. My question: is there a way to use Pig remotely in this way?
Or do I need to have Hive running on the edge node where I run my Pig jobs?
Thanks,
Adam
java.lang.RuntimeException:
org.apache.thrift.transport.TTransportException: Invalid status -128
at
org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:227)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status
-128
at
org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:230)
at
org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
at
org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at
org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:262)
at
org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at
org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 4 more
