Thank you for the tips, I will try these out
From: Josh Mahonin
Sent: 18 January 2024 21:07
To: Qing Lim
Cc: Jun Qin ; User
Subject: Re: Use different S3 access key for different S3 bucket
Oops my syntax was a bit off there, as shown in the Hadoop docs, it looks like:
fs.s3a.bucket..
Josh
Oops my syntax was a bit off there, as shown in the Hadoop docs, it looks
like:
fs.s3a.bucket..
Josh
>
nk/flink-docs-master/docs/deployment/filesystems/s3/#configure-access-credentials
>
>
>
> Thanks
>
>
>
> *From:* Jun Qin
> *Sent:* 18 January 2024 10:51
> *To:* User ; Qing Lim
> *Subject:* Re: Use different S3 access key for different S3 bucket
>
>
>
>
://nightlies.apache.org/flink/flink-docs-master/docs/deployment/filesystems/s3/#configure-access-credentials
Thanks
From: Jun Qin
Sent: 18 January 2024 10:51
To: User ; Qing Lim
Subject: Re: Use different S3 access key for different S3 bucket
Hi Qing
The S3 credentials are associated with Flink SQL tables.
I
Hi Qing
The S3 credentials are associated with Flink SQL tables.
I assume you are talking about processing/joining from two different tables,
backed up by two different S3 buckets. If so, you can provide different
credentials for different tables, then use the two tables in your pipeline.
Jun
