Hi all, The scalar Python UDF has already been supported in coming release of 1.10, we’d like to introduce Python UDTF now. FLIP-58[1] has already introduced some content about Python UDTF. However, the implementation details are still not touched. I have drafted a design doc[2]. It includes the following items:
- How to define Python UDTF. - The introduced rules for Python UDTF. - How to execute Python UDTF. Because the implementation relies on Beam's portability framework for Python user-defined table function execution and not all the contributors are familiar with it, I have done a prototype[3]. Welcome any feedback. Best, Xingbo [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-58%3A+Flink+Python+User-Defined+Stateless+Function+for+Table [2] https://docs.google.com/document/d/1Pkv5S0geoYQ2ySS5YTTBivJ3hoi-uzLXVQkDVIaR0cE/edit#heading=h.pzeztvig3kg1 [3] https://github.com/HuangXingBo/flink/commits/FLINK-UDTF