hi Yuxia,
Thanks for your reply. Your reminder is very important ! Since we download the file to the local, remember to clean it up when the flink client exits -- Best regards, Mang Zhang At 2022-03-23 10:02:26, "罗宇侠(莫辞)" <luoyuxia.luoyu...@alibaba-inc.com.INVALID> wrote: >Hi Ron, Thanks for starting this dicuss, some Spark/Hive users will benefit >from it. The flip looks good to me. I just have two minor questions: >1. For synax explanation, I see it's "Create .... function as identifier....", >I think the word "identifier" may not be self-dedescriptive for actually it's >not a random name but the name of the class that provides the implementation >for function to be create. >May be it'll be more clear to use "class_name" replace "identifier" just like >what Hive[1]/Spark[2] do. > >2. >> If the resource used is a remote resource, it will first download the >resource to a local temporary directory, which will be generated using UUID, >and then register the local path to the user class loader. >For the above explanation in this FLIP, It seems for such statement sets, >"" >Create function as org.apache.udf1 using jar 'hdfs://myudfs.jar'; >Create function as org.apache.udf2 using jar 'hdfs://myudfs.jar'; >"" > it'll download the resource 'hdfs://myudfs.jar' for twice. So is it possible > to provide some cache mechanism that we won't need to download / store for > twice? > > >Best regards, >Yuxia >[1] https://cwiki.apache.org/confluence/display/hive/languagemanual+ddl >[2] >https://spark.apache.org/docs/3.0.0-preview/sql-ref-syntax-ddl-create-function.html------------------------------------------------------------------ >发件人：Mang Zhang<zhangma...@163.com> >日 期：2022年03月22日 11:35:24 >收件人：<dev@flink.apache.org> >主 题：Re:[DISCUSS] FLIP-214 Support Advanced Function DDL > >Hi Ron, Thank you so much for this suggestion, this is so good. >In our company, when users use custom UDF, it is very inconvenient, and the >code needs to be packaged into the job jar, >and cannot refer to the existing udf jar through the existing udf jar. >Or pass in the jar reference in the startup command. >If we implement this feature, users can focus on their own business >development. >I can also contribute if needed. > > > > > > > > > > > > > > > >-- > >Best regards, >Mang Zhang > > > > > >At 2022-03-21 14:57:32, "刘大龙" <ld...@zju.edu.cn> wrote: >>Hi, everyone >> >> >> >> >>I would like to open a discussion for support advanced Function DDL, this >>proposal is a continuation of FLIP-79 in which Flink Function DDL is defined. >>Until now it is partially released as the Flink function DDL with user >>defined resources is not clearly discussed and implemented. It is an >>important feature for support to register UDF with custom jar resource, users >>can use UDF more more easily without having to put jars under the classpath >>in advance. >> >>Looking forward to your feedback. >> >> >> >> >>[1] >>https://cwiki.apache.org/confluence/display/FLINK/FLIP-214+Support+Advanced+Function+DDL >> >> >> >> >>Best, >> >>Ron >> >> >
