Thanks for organizing this, please also include me in the meeting. As I briefly mentioned during the last community sync meeting, Amazon is in the process of contributing the data compaction engine that we use to manage our exabyte-scale data lake to the Ray project which is primarily in Python. And we are targeting Iceberg as its first open source table format implementation. It would be great to align the goals in this domain as we are also scoping the missing pieces in the Iceberg Python module to support this integration.
I have added some comments to the doc, and I will forward the meeting invite to a few people in the Ray community for a short introduction during the first meeting. Ray project: https://ray.io/ Amazon Ray Data Compactor: https://www.anyscale.com/ray-summit-2021/agenda/adventures-in-petabyte-scale-data-lake-table-management-with-ray-arrow-parquet-and-s3 Best, Jack Ye On Thu, Aug 12, 2021 at 9:03 AM Ryan Murray <rym...@gmail.com> wrote: > I would love to join and +1 for the timing. > > On Thu, Aug 12, 2021 at 5:54 PM Ryan Blue <b...@tabular.io> wrote: > >> I know there are a couple of people in CEST (UTC+2) that would like to >> join this sync. Maybe next Wednesday at 9 AM PDT (UTC-7) is a good time? >> >> On Thu, Aug 12, 2021 at 6:53 AM Jason Reid <jr...@tabular.io> wrote: >> >>> Hi Jun, thanks for organizing this and please include me. Thanks! >>> >>> On Thu, Aug 12, 2021 at 12:19 AM Jun H. <junhe...@gmail.com> wrote: >>> >>>> Hi everyone, >>>> >>>> Since early this year, we have started working on the iceberg python >>>> library to bring it up to date and support the new V2 spec. Here is a >>>> summary of the current feature plan >>>> <https://docs.google.com/document/d/1Plt78Gbm22yoybKOShNFNaJyLM7xJAH20nu25PumeMI/edit?usp=sharing>. >>>> We have a lot of interesting work to do. >>>> >>>> To keep the community in sync, we plan to set up a recurring iceberg >>>> python library sync meeting. Please let me know if you are interested in or >>>> have any questions. >>>> >>>> Thanks. >>>> >>>> Jun >>>> >>>> >> >> -- >> Ryan Blue >> Tabular >> >
