[ 
https://issues.apache.org/jira/browse/FLINK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860435#comment-17860435
 ] 

Mate Czagany commented on FLINK-35695:
--------------------------------------

[~Weijie Guo] I have talked with [~ferenc-csaky] that I can take this ticket, 
can you please assign it to me?

> Release Testing: Verify FLINK-32315: Support local file upload in K8s mode
> --------------------------------------------------------------------------
>
>                 Key: FLINK-35695
>                 URL: https://issues.apache.org/jira/browse/FLINK-35695
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Client / Job Submission
>            Reporter: Ferenc Csaky
>            Priority: Blocker
>              Labels: release-testing
>             Fix For: 1.20.0
>
>
> Follow up the test for FLINK-32315.
> In Flink 1.20, we introduced a local file upload possibility for Kubernetes 
> deployments. To verify this feature, you can check the relevant 
> [PR|https://github.com/apache/flink/pull/24303], which includes the docs, and 
> examples for more information.
> To test this feature, it is required to have an available Kubernetes cluster 
> to deploy to, and some DFS where Flink can deploy the local JAR. For a 
> sandbox setup, I recommend to install {{minikube}}. The flink-k8s-operator 
> [quickstart 
> guide|https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/try-flink-kubernetes-operator/quick-start/#prerequisites]
>  explains that pretty well ({{helm}} is not needed here). For the DFS, I have 
> a gist to setup Minio on a K8s pod 
> [here|https://gist.github.com/ferenc-csaky/fd7fee71d89cd389cac2da4a4471ab65].
> The two following main use-case should be handled correctly:
> # Deploy job with a local job JAR, but without further dependencies
> {code:bash}
> $ ./bin/flink run-application \
>     --target kubernetes-application \
>     -Dkubernetes.cluster-id=my-first-application-cluster \
>     -Dkubernetes.container.image=flink:1.20 \
>     -Dkubernetes.artifacts.local-upload-enabled=true \
>     -Dkubernetes.artifacts.local-upload-target=s3://my-bucket/ \
>     local:///path/to/TopSpeedWindowing.jar
> {code}
> # Deploy job with a local job JAR, and further dependencies (e.g. a UDF 
> included in a separate JAR).
> {code:bash}
> $ ./bin/flink run-application \
>     --target kubernetes-application \
>     -Dkubernetes.cluster-id=my-first-application-cluster \
>     -Dkubernetes.container.image=flink:1.20 \
>     -Dkubernetes.artifacts.local-upload-enabled=true \
>     -Dkubernetes.artifacts.local-upload-target=s3://my-bucket/ \
>     
> -Duser.artifacts.artifact-list=local:///tmp/my-flink-udf1.jar\;s3://my-bucket/my-flink-udf2.jar
>  \
>     local:///tmp/my-flink-job.jar
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to