Re: Spark DataFrame callUdf does not compile?

2015-12-28 Thread Hamel Kothari
Would you mind sharing more of your code? I can't really see the code that well from the attached screenshot but it appears that "Lit" is capitalized. Not sure what this method actually refers to but the definition in functions.scala is lowercased. Even if that's not it, some more code would be he

Re: Spark DataFrame callUdf does not compile?

2015-12-28 Thread Hamel Kothari
.html#callUDF(java.lang.String,%20org.apache.spark.sql.Column.. .) On Mon, Dec 28, 2015 at 10:48 AM Hamel Kothari wrote: > Would you mind sharing more of your code? I can't really see the code that > well from the attached screenshot but it appears that "Lit" is capitalized. > Not sure wha

Re: Spark DataFrame callUdf does not compile?

2015-12-28 Thread Hamel Kothari
ntioned > is that it works in Spark scala console so it does not have any problem of > calling it in not expected way. Hope now question is clear. > > On Mon, Dec 28, 2015 at 9:21 PM, Hamel Kothari > wrote: > >> Also, if I'm reading correctly, it looks like you'