Hi, Shubham
Which Flink version are you using?
AFAIK, the JobManager will recover the job from the HA store first, and it
won't submit the same job (identify be jobID) again if it has already been
recovered.
Best,
Weihua
On Tue, May 2, 2023 at 8:02 PM Shubham Bansal wrote:
> Hello everyone,
>
Hi DEROCCO,
I think you can check the startup command of the job on k8s to see if the
jar file is in the classpath.
If your job is DataStream, you need to add hadoop azure dependency in your
project, and if it is an SQL job, you need to include this jar file in your
Flink release package. Or you
Hi chris,
I think there is no existing method that allows you to customize placing
the operator on the specified node.
By the way, I think "predicting the optimal parallelism" of flink jobs is
interesting. Currently flink supports autoscaling mechanism, you can find
detailed information in this F
Sorry for the mix-up. I read your message wrong. Please ignore my last
reply.
On Fri, May 5, 2023 at 11:42 AM John Gerassimou
wrote:
> Hi Chris,
>
> You should be able to do this using nodeSelector, or taints and
> tolerations.
>
>
> https://github.com/apache/flink-kubernetes-operator/blob/main/
Hi Chris,
You should be able to do this using nodeSelector, or taints and tolerations.
https://github.com/apache/flink-kubernetes-operator/blob/main/helm/flink-kubernetes-operator/templates/flink-operator.yaml#L55:L61
Thanks
John
On Fri, May 5, 2023 at 8:38 AM wrote:
> Hi,
>
> is there a way
How can I add the package to the flink job or check if it is there?
From: Shammon FY
Sent: Thursday, May 4, 2023 9:59 PM
To: DEROCCO, CHRISTOPHER
Cc: user@flink.apache.org
Subject: Re: MSI Auth to Azure Storage Account with Flink Apache Operator not
working
Hi DEROCCO,
I think you need to che
Thanks Hang and Gyula for the quick response! That makes sense, I can
resolve manually for now.
On Thu, May 4, 2023 at 8:37 PM Hang Ruan wrote:
> Hi, Nathan,
>
> I think the previous discussion[1] is helpful for you.
>
> Best,
> Hang
>
> [1] https://lists.apache.org/thread/cgwsr6f1l3202ktwcvtyxt
Hi,
is there a way to manually define which node an operator should be placed in, using Kubernetes?
To give a bit more context, for my master's thesis, I'm looking into predicting the optimal parallelism degree for a node. To do so, we use a Zero Shot Model, which predicts the latency and t
The Apache Flink community is very happy to announce the release of Apache
flink-connector-jdbc 3.1.0. This connector supports Flink 1.16 and 1.17.
Apache Flink® is an open-source stream processing framework for
distributed, high-performing, always-available, and accurate data streaming
applicatio
