Re: Hive permanent functions are not available in Spark SQL

+user list On Tue, Sep 29, 2015 at 3:43 PM, Pala M Muthaia wrote: > Hi, > > I am trying to use internal UDFs that we have added as permanent functions > to Hive, from within Spark SQL query (using HiveContext), but i encounter > NoSuchObjectException, i.e. the function cou

Hive permanent functions are not available in Spark SQL

Hi, I am trying to use internal UDFs that we have added as permanent functions to Hive, from within Spark SQL query (using HiveContext), but i encounter NoSuchObjectException, i.e. the function could not be found. However, if i execute 'show functions' command in spark SQL, the permanent function

Re: Sources/pom for org.spark-project.hive

changes are needed, including editing the sources. We are looking at alternative approaches, since our customizations to Hive are pretty limited and may not warrant the effort required here. Thanks. On Tue, Aug 11, 2015 at 2:29 PM, Steve Loughran wrote: > > On 11 Aug 2015, at 12:25, Pala M M

Sources/pom for org.spark-project.hive

Hi, I am trying to make Spark SQL 1.4 work with our internal fork of Hive. We have some customizations in Hive (custom authorization, various hooks etc) that are all part of hive-exec. Given Spark's hive dependency is through org.spark-project.hive groupId, looks like i need to modify the definit

Absence of version 1.3 of spark-assembly jar

I am looking to take dependency on spark-assembly jar, version 1.3.0, for our spark code unit tests, but it's not available on maven central (only older versions are available). Looks like it's not getting released anymore, is that right? Our internal build system prevents us from including depend

Re: Building spark 1.2 from source requires more dependencies

ppens, a clean build fixes it. > > On Fri, Mar 27, 2015 at 7:09 PM, Pala M Muthaia > wrote: > > No, i am running from the root directory, parent of core. > > > > Here is the first set of errors that i see when i compile from source > (sorry > > the error messa

Re: Building spark 1.2 from source requires more dependencies

at scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99) at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132) at org.apache.maven.lifecycle.internal.MojoExecutor.execu

Re: Building spark 1.2 from source requires more dependencies

:jar:0.1:compile > [INFO] | +- org.mindrot:jbcrypt:jar:0.3m:compile > [INFO] | +- org.apache.thrift:libthrift:jar:0.7.0:compile > [INFO] | | \- javax.servlet:servlet-api:jar:2.5:compile > > FYI > > On Thu, Mar 26, 2015 at 3:36 PM, Pala M Muthaia < > mchett...@rocketfuelin