Re: Hive Generic UDF invoking Hbase

2015-09-30 Thread Jason Dere
, September 30, 2015 3:52 PM To: Hive community Subject: RE: Hive Generic UDF invoking Hbase Ryan - Yes, I have written UDFs and Generic UDFs before but this is the first time I wrote a UDF that calls Hbase tables. Jason - Yes in my Generic UDF I am using org.apache.hadoop.hbase.client.HTable​ , On

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Yogesh Keshetty
. The respective HBase jars are already set in the classpath. Subject: Re: Hive Generic UDF invoking Hbase From: jd...@hortonworks.com To: user@hive.apache.org Date: Wed, 30 Sep 2015 22:43:17 + So your custom UDF is using org.apache.hadoop.hbase.client.HTable​? How do you resolve your UDF

Re: Hive Generic UDF invoking Hbase

2015-09-30 Thread Jason Dere
, September 30, 2015 3:19 PM To: user@hive.apache.org Subject: RE: Hive Generic UDF invoking Hbase without seeing the code I really can't help. Have you written other functioning UDFs? Are you aware of the requirements? https://cwiki.apache.org/confluence/display/Hive/HivePlugins From: Y

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Ryan Harris
user@hive.apache.org; user@hive.apache.org Subject: RE: Hive Generic UDF invoking Hbase I believe It's not because of classpath. For a single task / for streaming it's working fine right. Sent from Outlook<http://aka.ms/Ox5hz3> On Wed, Sep 30, 2015 at 1:58 PM -0700, "Rya

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Yogesh Keshetty
better insights for you there. From: Yogesh Keshetty [mailto:yogesh.keshe...@outlook.com] Sent: Wednesday, September 30, 2015 2:48 PM To: Hive community Subject: RE: Hive Generic UDF invoking Hbase Jason and Ryan, Thanks for the solutions. It's now launching in MapReduce Mode. However,

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Ryan Harris
x27;t have as much experience troubleshooting custom UDFs, hopefully someone else will have better insights for you there. From: Yogesh Keshetty [mailto:yogesh.keshe...@outlook.com] Sent: Wednesday, September 30, 2015 2:48 PM To: Hive community Subject: RE: Hive Generic UDF invoking Hbase Jaso

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Yogesh Keshetty
:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 61 more FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask Subject: Re: Hive Generic UDF invoking Hbase F

Re: Hive Generic UDF invoking Hbase

2015-09-30 Thread Jason Dere
eptember 29, 2015 11:02 PM To: Hive community Subject: RE: Hive Generic UDF invoking Hbase Thanks for the reply Douglas. We haven't set up Tez yet. The default execution mode is MR. I checked the log files. There is no indication of map reduce logs for the program. There is no map reduce pr

RE: Hive Generic UDF invoking Hbase

2015-09-30 Thread Ryan Harris
ly. Anyone who has tried to call HBase tables from Hive UDFs? Please help us. Thanks in advance! From: douglas.mo...@thinkbiganalytics.com To: user@hive.apache.org Subject: Re: Hive Generic UDF invoking Hbase Date: Wed, 30 Sep 2015 03:24:53 + I'm guessing y

RE: Hive Generic UDF invoking Hbase

2015-09-29 Thread Yogesh Keshetty
les from Hive UDFs? Please help us. Thanks in advance! From: douglas.mo...@thinkbiganalytics.com To: user@hive.apache.org Subject: Re: Hive Generic UDF invoking Hbase Date: Wed, 30 Sep 2015 03:24:53 + I'm guessing you might now be using tez now where you were using MR before. You can

Re: Hive Generic UDF invoking Hbase

2015-09-29 Thread Moore, Douglas
I'm guessing you might now be using tez now where you were using MR before. You can tell hive to run in map reduce mode, by setting the hive execution mode, from within the hive script. See this page for details https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties To answer

Hive Generic UDF invoking Hbase

2015-09-29 Thread Yogesh Keshetty
Hi, I have a quick question about Hive Generic UDF’s. We are trying to do some CRUD operations on HBase tables from hive generic UDF. But, the issue here is until hive 0.13, it would generate map reduce task where we could track the status of execution. Once we migrated to hive 1.0, it doesn’t