Re: Spark can not access jar from HDFS !!

2015-05-11 Thread Ravindra
After upgrading to spark 1.3, these statements on hivecontext are working fine. Thanks On Mon, May 11, 2015, 12:15 Ravindra wrote: > Hi All, > > Thanks for suggestions. What I tried is - > hiveContext.sql ("add jar ") and that helps to complete the "create > temporary function" but while usi

Re: Spark can not access jar from HDFS !!

2015-05-10 Thread Ravindra
Hi All, Thanks for suggestions. What I tried is - hiveContext.sql ("add jar ") and that helps to complete the "create temporary function" but while using this function I get ClassNotFound for the class handling this function. The same class is present in the jar added . Please note that the s

Re: Spark can not access jar from HDFS !!

2015-05-09 Thread Michael Armbrust
That code path is entirely delegated to hive. Does hive support this? You might try instead using sparkContext.addJar. On Sat, May 9, 2015 at 12:32 PM, Ravindra wrote: > Hi All, > > I am trying to create custom udfs with hiveContext as given below - > scala> hiveContext.sql ("CREATE TEMPORARY