Re: FW: Custom UDF Loses Depenencies

2019-03-05 Thread Kevin Risden
Yea that sounds familiar. At my previous company we were trying to load JDBC drivers with a JDBC Storage Handler in Hive. We wanted it to be dynamic. To be completely honest, I don't know what the final solution we ended up with was though. We looked at aux jars instead of ADD JAR. It think it als

RE: FW: Custom UDF Loses Depenencies

2019-03-05 Thread Shawn Weeks
Ok maybe this scenario will sound familiar. I’ve written a quick and dirty groovy udf that prints out the current class path by iterating over this.class.classLoader and here is what I’m seeing. 1. !connect – Class Path Printer shows no instances of the jar in the class path 2. Execute s

RE: FW: Custom UDF Loses Depenencies

2019-03-05 Thread Shawn Weeks
I suspect it’s related to that. HIVE-11878 was for several of those issues but it’s included in my build. The function has worked fine for months in some environments and if we restart Hiveserver2 it will go back to working. I suspect it has to do with how jar shading works but I didn’t want to

Re: FW: Custom UDF Loses Depenencies

2019-03-05 Thread Kevin Risden
Different classloader potentially inside HS2? I know there used to be some interesting cases of classloading when trying to add custom UDFs. Not sure what the current state is. Kevin Risden On Tue, Mar 5, 2019 at 4:46 PM Shawn Weeks wrote: > Didn't here anything on the dev mailing list, has an

FW: Custom UDF Loses Depenencies

2019-03-05 Thread Shawn Weeks
Didn't here anything on the dev mailing list, has anyone here seen this scenario. Custom Hive Function starts throwing class not found errors but only after a while, the function runs fine most of the time and only has a single dependency. Thanks Shawn -Original Message- From: Shawn We