Re: Iceberg - Remove orphan files issue with glue catalog running on EMR

Based on the stacktrace, my thinking is that: 1. for the first 2 use cases, it seems like the dynamic catalog resolution is not properly done for the Spark environment: - https://github.com/apache/iceberg/blob/80ff749b823098db82d0a8dc48c7e9db5ab3741b/spark/src/main/java/org/apache/iceberg/spark/Sp

Fwd: Data encryption in Iceberg

Hi all, Per the sync this morning, we'll have a meeting on encryption-related efforts in Iceberg. Before we discuss the day/time options, let us know who's interested to join, please respond here or send a direct message to Ryan, Jack or myself. Cheers, Gidon -- Forwarded message --

Re: Data encryption in Iceberg

Hi Gidon, I would like to join the meeting. Thanks, Maya Anderson -- Forwarded message - > From: Gidon Gershinsky > Date: Wed, Sep 1, 2021 at 9:11 PM > Subject: Fwd: Data encryption in Iceberg > To: > > > Hi all, > > Per the sync this morning, we'll have a meeting on encryptio

Re: Data encryption in Iceberg

Hi Gideon, please add me to the meeting. On Wed, Sep 1, 2021 at 11:34 AM Maya Anderson wrote: > Hi Gidon, > > I would like to join the meeting. > > Thanks, > Maya Anderson > > > -- Forwarded message - >> From: Gidon Gershinsky >> Date: Wed, Sep 1, 2021 at 9:11 PM >> Subject: Fwd