Re: Flink k8s Operator on AWS?

2022-06-27 Thread Matt Casters
e.org/2021/02/10/native-k8s-with-ha.html > > > Best, > Yang > > Matt Casters 于2022年6月24日周五 23:48写道: > >> Yes of-course. I already feel a bit less intelligent for having asked >> the question ;-) >> >> The status now is that I managed to have it all puzzled

Re: Flink k8s Operator on AWS?

2022-06-24 Thread Matt Casters
Yes of-course. I already feel a bit less intelligent for having asked the question ;-) The status now is that I managed to have it all puzzled together. Copying the files from s3 to an ephemeral volume takes all of 2 seconds so it's really not an issue. The cluster starts and our fat jar and Ap

Re: Flink k8s Operator on AWS?

2022-06-24 Thread Matt Casters
commended and safe approach is to use > sessionjobs for this purpose. > > > Cheers, > Matyas > > On Tue, Jun 21, 2022 at 4:03 PM Matt Casters < > matt.cast...@neotechnology.com> wrote: > >> Thank you very much for the help Matyas and Gyula! >> >>

Re: Flink k8s Operator on AWS?

2022-06-22 Thread Matt Casters
;> You can launch a session cluster (without job spec) on the operator that >> allows submitting jars if you would like to avoid dealing with >> authentication, but the recommended and safe approach is to use >> sessionjobs for this purpose. >> >> >> Cheers, >> Matyas

Re: Flink k8s Operator on AWS?

2022-06-22 Thread Matt Casters
ernetes-operator-docs-main/docs/custom-resource/pod-template/#pod-template >>> >>> - FlinkSessionJobs comes with an artifact fetcher, but it may need some >>> tweaking to make it work on your environment: >>> >>> https://nightlies.apache.org/flink/flink

Re: Flink k8s Operator on AWS?

2022-06-21 Thread Matt Casters
tcher, but it may need some > tweaking to make it work on your environment: > > https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/docs/custom-resource/overview/#flinksessionjob-spec-overview > > I hope it helps, let us know if you have further questions. >

Flink k8s Operator on AWS?

2022-06-21 Thread Matt Casters
Hi Flink team! I'm interested in getting the new Flink Kubernetes Operator to work on AWS EKS. Following the documentation I got pretty far. However, when trying to run a job I got the following error: Only "local" is supported as schema for application mode. This assumes t > hat the jar is loc