: Ingo Bürk ; user
Subject: Re: Unable to use custom AWS credentials provider - 1.9.2
Well usually the plugins should be properly isolated but Flink 1.9 is quite old
so there is a chance the plugin classloader was not fully isolated.
But I also have a hard time concluding anything with the small
Heise
> *Sent:* Friday, July 30, 2021 11:26 AM
> *To:* Ingo Bürk
> *Cc:* user
> *Subject:* Re: Unable to use custom AWS credentials provider - 1.9.2
>
>
>
> Can you double-check if you have a AWSCredentialsProvider in your user
> jar or in your flink/lib/ ? Same for
Hi Arvid,
Yes, we do have AWSCredentialsProvider in our user JAR. It’s coming from
aws-java-sdk-core. Must we exclude that, then?
// ah
From: Arvid Heise
Sent: Friday, July 30, 2021 11:26 AM
To: Ingo Bürk
Cc: user
Subject: Re: Unable to use custom AWS credentials provider - 1.9.2
Can you
Can you double-check if you have a AWSCredentialsProvider in your user jar
or in your flink/lib/ ? Same for S3AUtils?
On Fri, Jul 30, 2021 at 9:50 AM Ingo Bürk wrote:
> Hi Andreas,
>
> Such an exception can occur if the class in question (your provider) and
> the one being checked (AWSCredential
Hi Andreas,
Such an exception can occur if the class in question (your provider) and
the one being checked (AWSCredentialsProvider) were loaded from
different class loaders.
Any chance you can try once with 1.10+ to see if it would work? It does
look like a Flink issue to me, but I'm not sure thi
Hi team, I'm trying to read and write from and to S3 using a custom AWS
Credential Provider using Flink v1.9.2 on YARN.
I followed the instructions to create a plugins directory in our Flink
distribution location and copy the FS implementation (I'm using s3-fs-hadoop)
package into it. I have al