Re: S3a Committer

2021-02-03 Thread Gourav Sengupta
Why s3a? Regards, Gourav Sengupta On Wed, Feb 3, 2021 at 7:35 AM YoungKun Min wrote: > Hi, > > I have almost the same problem with Ceph RGW, and currently do research > about Apache Iceberg and Databricks Delta(opensource version). > I think these libraries can address the problem. > > > 2021년

Re: S3a Committer

2021-02-02 Thread YoungKun Min
Hi, I have almost the same problem with Ceph RGW, and currently do research about Apache Iceberg and Databricks Delta(opensource version). I think these libraries can address the problem. 2021년 2월 3일 (수) 오후 3:44, Boris Litvak 님이 작성: > This December AWS announced https://aws.amazon.com/s3/consis

RE: S3a Committer

2021-02-02 Thread Boris Litvak
This December AWS announced https://aws.amazon.com/s3/consistency/, are you sure this is your problem? I think all these s3guard like wrappers are irrelevant right now. Please correct me if I am wrong. From: David Morin Sent: Tuesday, 2 February 2021 22:26 To: user@spark.apache.org Subject: S3a

Re: S3a Committer

2021-02-02 Thread David Morin
Yes, that's true but this is not (yet) the case of the Openstack Swift S3 API Le mar. 2 févr. 2021 à 21:41, Henoc a écrit : > S3 is strongly consistent now > https://aws.amazon.com/s3/consistency/ > > Regards, > Henoc > > On Tue, Feb 2, 2021, 10:27 PM David Morin > wrote: > >> Hi, >> >> I have

Re: S3a Committer

2021-02-02 Thread Henoc
S3 is strongly consistent now https://aws.amazon.com/s3/consistency/ Regards, Henoc On Tue, Feb 2, 2021, 10:27 PM David Morin wrote: > Hi, > > I have some issues at the moment with S3 API of Openstack Swift (S3a). > This one is eventually consistent and it causes lots of issues with my > distri