[
https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267661#comment-17267661
]
Xintong Song commented on FLINK-20811:
--------------------------------------
[~ZhenqiuHuang] [~nicholasjiang] [~trohrmann] [~jiang7chengzitc] [~fly_in_gis]
Let's first try to clarify the scope of the three related tickets. My
understanding from the above discussion is as follow.
* FLINK-20681: support hdfs paths for ship files/archives for yarn integration
* FLINK-20811 (this ticket): support http paths for ship files/archives for
yarn integration
* FLINK-20867: support local, hdfs and http paths for ship files/archives for
native k8s integration
Are we all on the same page?
And thank both [~nicholasjiang] and [~sanath.mv] for volunteering on this
effort.
[~nicholasjiang], you have mentioned willing to work on this ticket weeks ago.
Are you still interested?
> Support HTTP paths for yarn ship files/archives
> -----------------------------------------------
>
> Key: FLINK-20811
> URL: https://issues.apache.org/jira/browse/FLINK-20811
> Project: Flink
> Issue Type: New Feature
> Components: Deployment / YARN
> Reporter: Xintong Song
> Priority: Major
>
> Flink's Yarn integration supports shipping workload-specific local
> files/directories/archives to the Yarn cluster.
> As discussed in FLINK-20505, it would be helpful to support directly
> downloading contents from HTTP paths to the Yarn cluster, so that users won't
> need to first download the contents locally and then upload it to the Yarn
> cluster.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
