Hi Jincheng, Thanks for the reply and also looking forward to the feedback from the community.
Thanks, Dian > 在 2019年11月11日,下午2:34,jincheng sun <sunjincheng...@gmail.com> 写道: > > Hi all, > > +1, Thanks for bring up this discussion Dian! > > The Resource Management is very important for PyFlink UDF. So, It's great > if anyone can add more comments or inputs in the design doc or feedback in > ML. :) > > Best, > Jincheng > > Dian Fu <dian0511...@gmail.com> 于2019年11月5日周二 上午11:32写道: > >> Hi everyone, >> >> In FLIP-58[1] it will add the support of Python user-defined stateless >> function for Python Table API. It will launch a separate Python process for >> Python user-defined function execution. The resources used by the Python >> process should be managed properly by Flink’s resource management >> framework. FLIP-49[2] has proposed a unified memory management framework >> and PyFlink user-defined function resource management should be based on >> it. Jincheng, Hequn, Xintong, GuoWei and I discussed offline about this. I >> draft a design doc[3] and want to start a discussion about PyFlink >> user-defined function resource management. >> >> Welcome any comments on the design doc or giving us feedback on the ML >> directly. >> >> Regards, >> Dian >> >> [1] >> https://cwiki.apache.org/confluence/display/FLINK/FLIP-58%3A+Flink+Python+User-Defined+Stateless+Function+for+Table >> [2] >> https://cwiki.apache.org/confluence/display/FLINK/FLIP-49%3A+Unified+Memory+Configuration+for+TaskExecutors >> [3] >> https://docs.google.com/document/d/1LQP8L66Thu2yVv6YRSfmF9EkkMnwhBHGjcTQ11GUmFc/edit#heading=h.4q4ggaftf78m