Re: [SQL][PYTHON] UDF improvements.

2017-01-10 Thread Maciej Szymkiewicz
Thanks for your response Ryan. Here you are https://issues.apache.org/jira/browse/SPARK-19159 On 01/09/2017 07:30 PM, Ryan Blue wrote: > Maciej, this looks great. > > Could you open a JIRA issue for improving the @udf decorator and > possibly sub-tasks for the specific features from the gist? Tha

Re: [SQL][PYTHON] UDF improvements.

2017-01-09 Thread Ryan Blue
Maciej, this looks great. Could you open a JIRA issue for improving the @udf decorator and possibly sub-tasks for the specific features from the gist? Thanks! rb On Sat, Jan 7, 2017 at 12:39 PM, Maciej Szymkiewicz wrote: > Hi, > > I've been looking at the PySpark UserDefinedFunction and I have

[SQL][PYTHON] UDF improvements.

2017-01-07 Thread Maciej Szymkiewicz
Hi, I've been looking at the PySpark UserDefinedFunction and I have a couple of suggestions how it could be improved including: * Full featured decorator syntax. * Docstring handling improvements. * Lazy initialization. I summarized all suggestions with links to possible solutions in gist