hi Yuxia,

Thanks for your reply. Your reminder is very important !


Since we download the file to the local, remember to clean it up when the flink 
client exits













--

Best regards,
Mang Zhang





At 2022-03-23 10:02:26, "罗宇侠(莫辞)" <luoyuxia.luoyu...@alibaba-inc.com.INVALID> 
wrote:
>Hi Ron, Thanks for starting this dicuss, some Spark/Hive users will benefit 
>from it. The flip looks good to me. I just have two minor questions:
>1. For synax explanation, I see it's "Create .... function as identifier....", 
>I think the word "identifier" may not be self-dedescriptive for actually it's 
>not a random name but the name of the class that provides the implementation 
>for function to be create.
>May be it'll be more clear to use "class_name" replace "identifier" just like 
>what Hive[1]/Spark[2] do.
>
>2.  >> If the resource used is a remote resource, it will first download the 
>resource to a local temporary directory, which will be generated using UUID, 
>and then register the local path to the user class loader.
>For the above explanation in this FLIP, It seems for such statement sets,
>""
>Create  function as org.apache.udf1 using jar 'hdfs://myudfs.jar';
>Create  function as org.apache.udf2 using jar 'hdfs://myudfs.jar';
>""
> it'll download the resource 'hdfs://myudfs.jar' for twice. So is it possible 
> to provide some cache mechanism that we won't need to download / store for 
> twice?
> 
>
>Best regards,
>Yuxia
>[1] https://cwiki.apache.org/confluence/display/hive/languagemanual+ddl
>[2] 
>https://spark.apache.org/docs/3.0.0-preview/sql-ref-syntax-ddl-create-function.html------------------------------------------------------------------
>发件人:Mang Zhang<zhangma...@163.com>
>日 期:2022年03月22日 11:35:24
>收件人:<dev@flink.apache.org>
>主 题:Re:[DISCUSS] FLIP-214 Support Advanced Function DDL
>
>Hi Ron, Thank you so much for this suggestion, this is so good.
>In our company, when users use custom UDF, it is very inconvenient, and the 
>code needs to be packaged into the job jar, 
>and cannot refer to the existing udf jar through the existing udf jar.
>Or pass in the jar reference in the startup command.
>If we implement this feature, users can focus on their own business 
>development.
>I can also contribute if needed.
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>--
>
>Best regards,
>Mang Zhang
>
>
>
>
>
>At 2022-03-21 14:57:32, "刘大龙" <ld...@zju.edu.cn> wrote:
>>Hi, everyone
>>
>>
>>
>>
>>I would like to open a discussion for support advanced Function DDL, this 
>>proposal is a continuation of FLIP-79 in which Flink Function DDL is defined. 
>>Until now it is partially released as the Flink function DDL with user 
>>defined resources is not clearly discussed and implemented. It is an 
>>important feature for support to register UDF with custom jar resource, users 
>>can use UDF more more easily without having to put jars under the classpath 
>>in advance.
>>
>>Looking forward to your feedback.
>>
>>
>>
>>
>>[1] 
>>https://cwiki.apache.org/confluence/display/FLINK/FLIP-214+Support+Advanced+Function+DDL
>>
>>
>>
>>
>>Best,
>>
>>Ron
>>
>>
>

Reply via email to