Re: Iceberg disaster recovery and relative path sync-up

Hi Anjali, Inline... On Thu, Aug 12, 2021 at 5:31 PM Anjali Norwood wrote: > Thanks for the summary Yufei. > Sorry, if this was already discussed, I missed the meeting yesterday. > Is there anything in the design that would prevent multiple roots from > being in different aws regions? > No. DR i

Re: Iceberg disaster recovery and relative path sync-up

Thanks for the summary Yufei. Sorry, if this was already discussed, I missed the meeting yesterday. Is there anything in the design that would prevent multiple roots from being in different aws regions? For disaster recovery in the case of an entire aws region down or slow, is metastore still a poi

Re: Iceberg python library sync

+1, would love to listen in as well Thanks, Szehon > On 12 Aug 2021, at 12:48, Arthur Wiedmer > wrote: > > Hi Jun, > > Please add me as well! > > Best, > Arthur > > > > On Thu, Aug 12, 2021 at 12:19 AM Jun H. > wrote: > Hi everyone, > > Since early this year,

Re: Iceberg python library sync

Hi Jun, Please add me as well! Best, Arthur On Thu, Aug 12, 2021 at 12:19 AM Jun H. wrote: > Hi everyone, > > Since early this year, we have started working on the iceberg python > library to bring it up to date and support the new V2 spec. Here is a > summary of the current feature plan > <

Iceberg disaster recovery and relative path sync-up

Here is a summary of yesterday's community sync-up. Yufei gave a brief update on disaster recovery requirements and the current progress of relative path approach. Ryan: We all agreed that relative path is the way for disaster recovery. *Multiple roots for the relative path* Ryan proposed an

Re: Iceberg python library sync

Please add me to the invite as well. -Dan On Thu, Aug 12, 2021 at 10:25 AM Ted Gooch wrote: > Please add me as well. > > On Thu, Aug 12, 2021 at 9:26 AM Eduard Tudenhoefner > wrote: > >> I'd love to join as well and the time slot for EU folks is quite good. >> >> On Thu, Aug 12, 2021 at 6:22 P

Re: Iceberg python library sync

Please add me as well. On Thu, Aug 12, 2021 at 9:26 AM Eduard Tudenhoefner wrote: > I'd love to join as well and the time slot for EU folks is quite good. > > On Thu, Aug 12, 2021 at 6:22 PM Jack Ye wrote: > >> Thanks for organizing this, please also include me in the meeting. >> >> As I briefl

Re: Iceberg python library sync

I'd love to join as well and the time slot for EU folks is quite good. On Thu, Aug 12, 2021 at 6:22 PM Jack Ye wrote: > Thanks for organizing this, please also include me in the meeting. > > As I briefly mentioned during the last community sync meeting, Amazon is > in the process of contributing

Re: Iceberg python library sync

Thanks for organizing this, please also include me in the meeting. As I briefly mentioned during the last community sync meeting, Amazon is in the process of contributing the data compaction engine that we use to manage our exabyte-scale data lake to the Ray project which is primarily in Python. A

Re: Iceberg python library sync

I would love to join and +1 for the timing. On Thu, Aug 12, 2021 at 5:54 PM Ryan Blue wrote: > I know there are a couple of people in CEST (UTC+2) that would like to > join this sync. Maybe next Wednesday at 9 AM PDT (UTC-7) is a good time? > > On Thu, Aug 12, 2021 at 6:53 AM Jason Reid wrote:

Re: Iceberg python library sync

I know there are a couple of people in CEST (UTC+2) that would like to join this sync. Maybe next Wednesday at 9 AM PDT (UTC-7) is a good time? On Thu, Aug 12, 2021 at 6:53 AM Jason Reid wrote: > Hi Jun, thanks for organizing this and please include me. Thanks! > > On Thu, Aug 12, 2021 at 12:19

Re: Iceberg python library sync

Hi Jun, thanks for organizing this and please include me. Thanks! On Thu, Aug 12, 2021 at 12:19 AM Jun H. wrote: > Hi everyone, > > Since early this year, we have started working on the iceberg python > library to bring it up to date and support the new V2 spec. Here is a > summary of the curre

Iceberg python library sync

Hi everyone, Since early this year, we have started working on the iceberg python library to bring it up to date and support the new V2 spec. Here is a summary of the current feature plan . We have a