You can do this:
strLen = udf((s: String) => s.length())
cleanProcessDF.withColumn("dii",strLen(col("di")))
(You might need to play with the type signature a little bit to get it to
compile)
On Fri, Apr 10, 2015 at 11:30 AM, Yana Kadiyska
wrote:
> Hi, I'm running into some trouble trying to r
Hi,
It's a syntax error in Spark-1.3.
The next release of spark supports the kind of UDF calls in DataFrame.
See a link below.
https://issues.apache.org/jira/browse/SPARK-6379
On Sat, Apr 11, 2015 at 3:30 AM, Yana Kadiyska
wrote:
> Hi, I'm running into some trouble trying to register a UDF:
>
