flink operator.
From: Ivan Webber
Sent: Tuesday, May 16, 2023 8:01 PM
To: DEROCCO, CHRISTOPHER ; Shammon FY
Cc: user@flink.apache.org
Subject: RE: MSI Auth to Azure Storage Account with Flink Apache Operator not
working
When you create your cluster you probably need to ensure the following setti
shaded.hadoop3.org.apache.hadoop.fs.azurebfs.oauth2.MsiTokenProvider*
>
>
>
>
>
> *From:* Surendra Singh Lilhore
> *Sent:* Tuesday, May 16, 2023 11:46 PM
> *To:* Ivan Webber
> *Cc:* DEROCCO, CHRISTOPHER ; Shammon FY ;
> user@flink.apache.org
> *Subject:* Re: MSI Auth t
Webber
Cc: DEROCCO, CHRISTOPHER ; Shammon FY ;
user@flink.apache.org
Subject: Re: MSI Auth to Azure Storage Account with Flink Apache Operator not
working
Hi DEROCCO,
Flink uses shaded jars for the Hadoop Azure Storage plugin, so in order to
correct the ClassNotFoundException, you need to
g>
Subject: [EXTERNAL] RE: MSI Auth to Azure Storage Account with Flink Apache
Operator not working
You don't often get email from cd9...@att.com<mailto:cd9...@att.com>. Learn why
this is
important<https://urldefense.com/v3/__https:/aka.ms/LearnAboutSenderIdent
s somehow helpful.
>
>
>
> Best of luck,
>
>
>
> Ivan
>
>
>
> *From: *DEROCCO, CHRISTOPHER
> *Sent: *Monday, May 8, 2023 3:40 PM
> *To: *Shammon FY
> *Cc: *user@flink.apache.org
> *Subject: *[EXTERNAL] RE: MSI Auth to Azure Storage Ac
FY
Sent: Friday, May 5, 2023 8:38 PM
To: DEROCCO, CHRISTOPHER
Cc: user@flink.apache.org
Subject: Re: MSI Auth to Azure Storage Account with Flink Apache Operator not
working
Hi DEROCCO,
I think you can check the startup command of the job on k8s to see if the jar
file is in the classpath.
I
with writing checkpoints to Azure ADLS2gen Storage with managed service
identity (MSI) authentication.?
From: Shammon FY
Sent: Friday, May 5, 2023 8:38 PM
To: DEROCCO, CHRISTOPHER
Cc: user@flink.apache.org
Subject: Re: MSI Auth to Azure Storage Account with Flink Apache Operator not
working
PM
> *To:* DEROCCO, CHRISTOPHER
> *Cc:* user@flink.apache.org
> *Subject:* Re: MSI Auth to Azure Storage Account with Flink Apache
> Operator not working
>
>
>
> Hi DEROCCO,
>
>
>
> I think you need to check whether there is a hadoop-azure jar file in the
> class
How can I add the package to the flink job or check if it is there?
From: Shammon FY
Sent: Thursday, May 4, 2023 9:59 PM
To: DEROCCO, CHRISTOPHER
Cc: user@flink.apache.org
Subject: Re: MSI Auth to Azure Storage Account with Flink Apache Operator not
working
Hi DEROCCO,
I think you need to
Hi DEROCCO,
I think you need to check whether there is a hadoop-azure jar file in the
classpath of your flink job. From an error message '*Caused by:
java.lang.ClassNotFoundException: Class
org.apache.hadoop.fs.azurebfs.oauth2.MsiTokenProvider not found.*', your
flink job may be missing this packa
I receive the error: Caused by: java.lang.ClassNotFoundException: Class
org.apache.hadoop.fs.azurebfs.oauth2.MsiTokenProvider not found.
I'm using flink 1.16 running in Azure Kubernetes using the Flink Apache
Kubernetes Operator.
I have the following specified in the spec.flinkConfiguration: as
11 matches
Mail list logo
