Chenya Zhang created FLINK-25964:
------------------------------------

             Summary: Support shipping extra local files/jars to job/task 
manager classpaths
                 Key: FLINK-25964
                 URL: https://issues.apache.org/jira/browse/FLINK-25964
             Project: Flink
          Issue Type: New Feature
          Components: Client / Job Submission
            Reporter: Chenya Zhang


There is no direct support on shipping extra local files/jars to job/task 
manager classpaths besides the application jar.

Users have to either build their own docker image to bake in the extra 
dependencies or upload to remote file systems first.

Features similar to `spark.files`, `spark.jars`, and `spark.archives` can be 
very helpful. ([https://spark.apache.org/docs/latest/configuration.html)]

>From the client side, it can look like:

$ ./bin/flink run-application \ --target kubernetes-application \ 
-Dkubernetes.cluster-id=my-first-application-cluster \ 
-Dkubernetes.container.image=custom-image-name \ --files 
local:///local/file/path \--jars local:///local/jar/path \ 
local:///opt/flink/usrlib/my-flink-job.jar

(https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/deployment/resource-providers/native_kubernetes/#application-mode)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to