[ https://issues.apache.org/jira/browse/FLINK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17862530#comment-17862530 ]
Mate Czagany commented on FLINK-35695: -------------------------------------- h2. Verification Conclusion Using the steps described below, I could confirm that the new feature works as expected and documented. > Release Testing: Verify FLINK-32315: Support local file upload in K8s mode > -------------------------------------------------------------------------- > > Key: FLINK-35695 > URL: https://issues.apache.org/jira/browse/FLINK-35695 > Project: Flink > Issue Type: Sub-task > Components: Client / Job Submission > Reporter: Ferenc Csaky > Assignee: Mate Czagany > Priority: Blocker > Labels: release-testing > Fix For: 1.20.0 > > Attachments: image-2024-07-01-14-54-17-770.png, > image-2024-07-01-15-04-53-764.png > > > Follow up the test for FLINK-32315. > In Flink 1.20, we introduced a local file upload possibility for Kubernetes > deployments. To verify this feature, you can check the relevant > [PR|https://github.com/apache/flink/pull/24303], which includes the docs, and > examples for more information. > To test this feature, it is required to have an available Kubernetes cluster > to deploy to, and some DFS where Flink can deploy the local JAR. For a > sandbox setup, I recommend to install {{minikube}}. The flink-k8s-operator > [quickstart > guide|https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/try-flink-kubernetes-operator/quick-start/#prerequisites] > explains that pretty well ({{helm}} is not needed here). For the DFS, I have > a gist to setup Minio on a K8s pod > [here|https://gist.github.com/ferenc-csaky/fd7fee71d89cd389cac2da4a4471ab65]. > The two following main use-case should be handled correctly: > # Deploy job with a local job JAR, but without further dependencies > {code:bash} > $ ./bin/flink run-application \ > --target kubernetes-application \ > -Dkubernetes.cluster-id=my-first-application-cluster \ > -Dkubernetes.container.image=flink:1.20 \ > -Dkubernetes.artifacts.local-upload-enabled=true \ > -Dkubernetes.artifacts.local-upload-target=s3://my-bucket/ \ > local:///path/to/TopSpeedWindowing.jar > {code} > # Deploy job with a local job JAR, and further dependencies (e.g. a UDF > included in a separate JAR). > {code:bash} > $ ./bin/flink run-application \ > --target kubernetes-application \ > -Dkubernetes.cluster-id=my-first-application-cluster \ > -Dkubernetes.container.image=flink:1.20 \ > -Dkubernetes.artifacts.local-upload-enabled=true \ > -Dkubernetes.artifacts.local-upload-target=s3://my-bucket/ \ > > -Duser.artifacts.artifact-list=local:///tmp/my-flink-udf1.jar\;s3://my-bucket/my-flink-udf2.jar > \ > local:///tmp/my-flink-job.jar > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)