Re: Drop table behavior

; someone with context could provide more details. >>> >>> For item 2, I think this aligns with the discussion conclusions in the >>> linked issues. At least we can have some flag saying the table location, >>> data location and metadata location do not have other tabl

Drop table behavior

Hi everyone, Does anyone know across catalog implementations, when we drop tables with *purge=true*, why do we only drop last metadata and files referred by it, but not any of the previous metadata? e.g. *create iceberg table1*; <--- metadata.json-1 *insert into table1* ...; <--- metadata.json-2

Re: Welcome new PMC members!

Congratulations, Jack and Russel! On Thu, Nov 18, 2021 at 7:58 AM Jun H. wrote: > Congrats Jack and Russell! Well deserved. > > > On Nov 18, 2021, at 7:12 AM, Dmitri Bourlatchkov < > dmitri.bourlatch...@dremio.com> wrote: > >  > Congrats Jack and Russell > > On Wed, Nov 17, 2021 at 7:12 PM Ryan

Re: [VOTE] Adopt the v2 spec changes

+1 (non-binding) On Wed, Jul 28, 2021 at 10:52 AM Yufei Gu wrote: > +1 (non-binding) > Best, > > Yufei > > `This is not a contribution` > > > On Wed, Jul 28, 2021 at 8:34 AM Ryan Murray wrote: > >> +1 (non-binding) >> >> On Wed, Jul 28, 2021 at 5:14 PM Russell Spitzer < >> russell.spit...@gmail

Re: [DISCUSS] UUID type

One conversation I used to come across regarding UUID deprecation was from https://github.com/apache/iceberg/pull/1611 Thanks, Yan On Tue, Jul 27, 2021 at 1:07 PM Peter Vary wrote: > Hi Joshua, > > I do not have a strong preference about the UUID type, but I would like > the highlight, that the

Re: Trino Iceberg

Hi Ivan, Today Trino Iceberg connector does not support Glue catalog. However Jack has authored a PR for this support in Trino community that you may be interested in: https://github.com/trinodb/trino/pull/6977 Yan On Mon, Jul 12, 2021 at 4:31 PM Ivan Yang wrote: > Dear Iceberg community, > >

Re: Welcoming OpenInx as a new PMC member!

Congratulations!! And thanks for sharing the information! On Wed, Jun 30, 2021 at 8:47 AM Palash Goel wrote: > Congratulations 🎉 > > On Wed, 30 Jun, 2021, 21:14 Eduard Tudenhoefner, > wrote: > >> Congratulations! >> >> On Wed, Jun 30, 2021 at 4:43 PM Peidian Li wrote: >> >>> Congratulations! >

Re: [VOTE] Release Apache Iceberg 0.11.1 RC0

+1 (non-binding) Verified steps mentioned in the link, and ran some sample queries with glue catalog in EMR. Yan On Tue, Mar 30, 2021 at 4:50 AM Ryan Murray wrote: > +1 (non-binding) > > verified build, tests, signature, checksum. > > Best, > Ryan > > On Tue, Mar 30, 2021 at 4:40 AM Jack Ye

Re: Welcoming Ryan Murray as a new committer!

Congratulations, Ryan! On Mon, Mar 29, 2021 at 9:10 PM Edgar Rodriguez wrote: > Congratulations, Ryan! > > Best, > > On Mon, Mar 29, 2021 at 10:39 PM Jack Ye wrote: > >> Congratulations Ryan! >> >> On Mon, Mar 29, 2021 at 7:25 PM OpenInx wrote: >> >>> Congrats, Ryan ! Well-deserved ! >>> >>>

Re: Welcoming Russell Spitzer as a new committer

Congratulations, Russell! On Mon, Mar 29, 2021 at 9:10 PM Edgar Rodriguez wrote: > Congrats, Russell! > > Cheers, > > On Mon, Mar 29, 2021 at 11:01 PM Robin Stephen > wrote: > >> Congratulations, Russell! >> >> Jack Ye 于2021年3月30日周二 上午10:39写道： >> >>> Congratulations Russell! >>> >>> On Mon, Ma

Re: Welcoming Yan Yan as a new committer!

43, Yufei Gu wrote: > >>>> > >>>> Congratulations, Yan! > >>>> > >>>> Best, > >>>> > >>>> Yufei > >>>> > >>>> `This is not a contribution` > >>>> > >

Re: Iceberg sync notes - 10 March 2021

now as we handle the plan construction ourselves. There will be >> an API in Spark 3.2 to request a specific distribution and ordering for >> normal writes. There are also similar efforts in Flink. >> >> - Anton >> >> On 16 Mar 2021, at 17:03, Yan Yan wrote: >&g

Re: Iceberg sync notes - 10 March 2021

data when > read using core data API, what is the right and required things to do? > > Thanks, > Chen > > > On Tue, Mar 16, 2021 at 4:05 PM Yan Yan wrote: > >> Hi Chen, >> >> Here is the doc on remaining tasks for format V2 that I updated with the >>

Re: Iceberg sync notes - 10 March 2021

Hi Chen, Here is the doc on remaining tasks for format V2 that I updated with the latest status today, including individual PRs pending review and tasks needed that are V2-blocking: https://docs.google.com/document/d/1FyLJyvzcZbfbjwDMEZd6Dj-LYCfrzK1zC-Bkb3OiICc/edit Please feel free to comment/edi

Re: Welcoming Peter Vary as a new committer!

Congratulations! On Mon, Jan 25, 2021 at 3:03 PM Jun Zhang wrote: > Congratulations > On 01/26/2021 04:25, Driesprong, Fokko wrote: > > Congratulations! > > Op ma 25 jan. 2021 om 21:16 schreef Mass Dosage > >> Nice one, well done Peter! >> >> On Mon, 25 Jan 2021 at 19:46, Daniel Weeks wrote:

Re: [VOTE] Release Apache Iceberg 0.11.0 RC0

+1 after I did the following verifications and ran a few sample spark commands: 1. Download the source tarball, signature (.asc), and checksum (.sha512): OK 2. Import gpg keys: download KEYS and run gpg --import /path/to/downloaded/KEYS (optional if this hasn’t changed) : OK 3. Verify the signatu

Re: What's the time to expose iceberg format v2 to end users ?

Hi OpenInx, Thanks for bringing this up. I am currently working on Format v2 blocking tasks, and am maintaining a full list of blocking tasks with their description and current status here after spe

Seeking Suggestions on Implementing NaN Counters for Metrics

Hi Iceberg community, I'm from Amazon and very new to the space, so please bear with me for any naive questions. I'm currently looking into adding NaN counts for float and double columns (described in #348 ). I noticed that metrics like upper/lower boun