On Fri, Jul 4, 2014 at 11:39 AM, Michael Armbrust <mich...@databricks.com> wrote: > On Fri, Jul 4, 2014 at 1:59 AM, Martin Gammelsæter > <martingammelsae...@gmail.com> wrote: >> >> is there any way to write user defined functions for Spark SQL? > This is coming in Spark 1.1. There is a work in progress PR here: > https://github.com/apache/spark/pull/1063
Sweet. Any idea about when this will be merged into master? > If you have a hive context, you can also create udfs using the standard Hive > APIs and use them in your hive ql queries. This is probably a stupid question, but can you query Spark SQL tables from a (local?) hive context? In which case using that could be a workaround until the PR is merged. -- Best regards, Martin Gammelsæter