Re: Identify watermark in the iceberg table properties

2021-08-17 Thread Peidian Li
+1, we haven the same needs, hope the solution to this problem. Thanks.

Re: create iceberg on minio s3 got "The AWS Access Key Id you provided does not exist in our records."

2021-08-17 Thread Lian Jiang
Thanks for clarifying. I will investigate your solution later for using S3FileIO. On Tue, Aug 17, 2021 at 11:40 AM Jack Ye wrote: > Good to hear the issue is fixed! > > ACL is optional, as the javadoc says, "If not set, ACL will not be set for > requests". > > But I think to use MinIO you need t

Re: create iceberg on minio s3 got "The AWS Access Key Id you provided does not exist in our records."

2021-08-17 Thread Jack Ye
Good to hear the issue is fixed! ACL is optional, as the javadoc says, "If not set, ACL will not be set for requests". But I think to use MinIO you need to use a custom client factory to set your S3 endpoint as that MinIO endpoint. -Jack On Tue, Aug 17, 2021 at 11:36 AM Lian Jiang wrote: > Hi

Re: create iceberg on minio s3 got "The AWS Access Key Id you provided does not exist in our records."

2021-08-17 Thread Lian Jiang
Hi Ryan, S3FileIO need canned ACL according to: /** * Used to configure canned access control list (ACL) for S3 client to use during write. * If not set, ACL will not be set for requests. * * The input must be one of {@link software.amazon.awssdk.services.s3.model.ObjectCannedACL},

Re: create iceberg on minio s3 got "The AWS Access Key Id you provided does not exist in our records."

2021-08-17 Thread Ryan Blue
I'm not sure that I'm following why MinIO won't work with S3FileIO. S3FileIO assumes that the credentials are handled by a credentials provider outside of S3FileIO. How does MinIO handle credentials? Ryan On Mon, Aug 16, 2021 at 7:57 PM Jack Ye wrote: > Talked with Lian on Slack, the user is us