[
https://issues.apache.org/jira/browse/FLINK-32315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
melin updated FLINK-32315:
--------------------------
Attachment: image-2024-10-29-11-32-25-979.png
> Support local file upload in K8s mode
> -------------------------------------
>
> Key: FLINK-32315
> URL: https://issues.apache.org/jira/browse/FLINK-32315
> Project: Flink
> Issue Type: New Feature
> Components: Client / Job Submission, Deployment / Kubernetes
> Reporter: Paul Lin
> Assignee: Ferenc Csaky
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.20.0
>
> Attachments: image-2024-10-29-11-32-25-979.png
>
>
> Currently, Flink assumes all resources are locally accessible in the pods,
> which requires users to prepare the resources by mounting storages,
> downloading resources with init containers, or rebuilding images for each
> execution.
> We could make things much easier by introducing a built-in file distribution
> mechanism based on Flink-supported filesystems. It's implemented in two steps:
>
> 1. KubernetesClusterDescripter uploads all local resources to remote storage
> via Flink filesystem (skips if the resources are already remote).
> 2. KubernetesApplicationClusterEntrypoint and KubernetesTaskExecutorRunner
> download the resources and put them in the classpath during startup.
>
> The 2nd step is mostly done by
> [FLINK-28915|https://issues.apache.org/jira/browse/FLINK-28915], thus this
> issue is focused on the upload part.
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
