[
https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17256483#comment-17256483
]
Xintong Song commented on FLINK-20811:
--------------------------------------
[~ZhenqiuHuang] and I had a offline discussion earlier today, during which the
following idea was brought up.
If we want to support downloading remote files to the cluster directly, why
limiting this feature to the Yarn integration? Can we also support this feature
for the native K8s integration?
> Support HTTP paths for yarn ship files/archives
> -----------------------------------------------
>
> Key: FLINK-20811
> URL: https://issues.apache.org/jira/browse/FLINK-20811
> Project: Flink
> Issue Type: New Feature
> Components: Deployment / YARN
> Reporter: Xintong Song
> Priority: Major
>
> Flink's Yarn integration supports shipping workload-specific local
> files/directories/archives to the Yarn cluster.
> As discussed in FLINK-20505, it would be helpful to support directly
> downloading contents from HTTP paths to the Yarn cluster, so that users won't
> need to first download the contents locally and then upload it to the Yarn
> cluster.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
