[
https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17256466#comment-17256466
]
zoucao commented on FLINK-20811:
--------------------------------
hi [~xintongsong], I am OK, if [~nicholasjiang] would like to take it and is
familiar with it.
I think the first thing we need to do is changing the pattern in
`YarnLocalResourceDescriptor`. The path from `yarn ship files/archives` will be
added in `envShipResourceList` if it is not lost in `if else ...`, so that I
think http path will work after added successfully.
hi [~fly_in_gis], I quite agree with your suggesttion. It will be great, if
other remote path Flink can support, just like ftp .... But I am not sure
whether users really need it.
> Support HTTP paths for yarn ship files/archives
> -----------------------------------------------
>
> Key: FLINK-20811
> URL: https://issues.apache.org/jira/browse/FLINK-20811
> Project: Flink
> Issue Type: New Feature
> Components: Deployment / YARN
> Reporter: Xintong Song
> Priority: Major
>
> Flink's Yarn integration supports shipping workload-specific local
> files/directories/archives to the Yarn cluster.
> As discussed in FLINK-20505, it would be helpful to support directly
> downloading contents from HTTP paths to the Yarn cluster, so that users won't
> need to first download the contents locally and then upload it to the Yarn
> cluster.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
