[
https://issues.apache.org/jira/browse/FLINK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199804#comment-17199804
]
Jark Wu edited comment on FLINK-19335 at 9/22/20, 4:47 AM:
-----------------------------------------------------------
Module is a mechanism to support built-in functions which should always be in
the classpath.
So I'm afraid it may conflict with the current mechanism to support dynamic
loading for modules.
IIUC, what you want is the `CREATE FUNCTION ... USING JAR` which is discussed
in FLINK-14055 [1].
[1]: https://issues.apache.org/jira/browse/FLINK-14055
was (Author: jark):
Module is a mechanism to support built-in functions which should always be in
the classpath.
So I'm afraid it may conflict with the current mechanism to support dynamic
loading for modules.
IIUC, what you want is the `CREATE FUNCTION ... USING JAR` which is discussed
in FLINK-14055 [1].
Best,
Jark
[1]: https://issues.apache.org/jira/browse/FLINK-14055
> Automatically get udf's resource files from hdfs when running a job that
> uses hive-udf
> ---------------------------------------------------------------------------------------
>
> Key: FLINK-19335
> URL: https://issues.apache.org/jira/browse/FLINK-19335
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Hive
> Environment: yarn ，per-job mode
> Reporter: Husky Zeng
> Priority: Major
>
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Is-there-a-way-to-avoid-submit-hive-udf-s-resources-when-we-submit-a-job-td38204.html
> As the mail say，maintain a copy of udf's files in flink-client is a big
> trouble in my production environment , which blocked our automated task
> submission , and easy to cause asynchronous problems .
> So I plan to develop a feature ——automatically get udf's resource files from
> hdfs when running a job that uses hive-udf. Do you think this function is
> beneficial to the community ? Or any suggestion ?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
