Re: MV Query Planning Use Case

2024-03-07 Thread Walaa Eldin Moustafa
Hi Benny, For the first part of your question, yes, the intention is to switch between the virtual view and the materialized storage table transparently, and use the storage table as long as it is fresh. For the second part, this dimension of the MV problem has been discussed as part of the curre

MV Query Planning Use Case

2024-03-07 Thread Benny Chow
Hey Everyone I've been following the MV spec and listened in on the last community sync. I'd like to chime in from a query planner point of view on how the MVs could be used. Suppose a user has a dashboard query like: *SELECT product, sum(sales) * *FROM view1 * *WHERE brand = 'X' and year = '20

Re: [VOTE] Release Apache Iceberg 1.5.0 RC6

2024-03-07 Thread Hussein Awala
+1 (non-binding) - checked checksum and signature - built from source with jdk11 - tested read and write with Spark 3.5.1 and Glue catalog All looks good On Thu, Mar 7, 2024 at 10:49 PM Drew wrote: > +1 (non-binding) > > - verified signature and checksum > - verified RAT license check > - verif

Re: [VOTE] Release Apache Iceberg 1.5.0 RC6

2024-03-07 Thread Drew
+1 (non-binding) - verified signature and checksum - verified RAT license check - verified build/tests passing with JDK17 - ran some manual tests on Spark3.5 with GlueCatalog Drew On Thu, Mar 7, 2024 at 4:38 AM Ajantha Bhat wrote: > +1 (non-binding) > > * validated checksum and signature > * c

Re: [DISCUSS] What do we plan for Iceberg 2.0.0 ?

2024-03-07 Thread Jean-Baptiste Onofré
Hi Ryan Yeah I agree to separate discussions on each topic. Actually that was my intention ;) I just wanted to have thoughts from everyone about roadmap/timeline. Jack and I will start a dedicated thread about REST catalog. Thanks ! Regards JB Le jeu. 7 mars 2024 à 18:34, Ryan Blue a écrit

Re: [DISCUSS] What do we plan for Iceberg 2.0.0 ?

2024-03-07 Thread Ryan Blue
Hi JB, Specs and libraries are versioned separately. In fact, the v2 spec has already been voted on and adopted. The next spec version is v3. I think we do want to get to a 2.0 of the Java library sometime soon to drop some deprecated APIs and clean up a few things, but I don't think that we're q

Re: [DISCUSS] What do we plan for Iceberg 2.0.0 ?

2024-03-07 Thread Jean-Baptiste Onofré
Hi guys, Let me ping again on this thread ;) I think it would be great to give some visibility to the community, especially about Spec v3 and Iceberg 2.0.0. Any comments about Spec V2 / Iceberg 2.0.0 ? Thanks ! Regards JB On Fri, Feb 16, 2024 at 4:52 PM Jean-Baptiste Onofré wrote: > > Hi guys

Re: [ANNOUNCE] Iceberg Summit Call for Proposals

2024-03-07 Thread Jean-Baptiste Onofré
Hi Ajantha, We will discuss that within the Selection Committee. I think it would be great to reserve one slot (30mn) for lightning talks (as we do at ApacheCon/CoC), meaning 6 lightning talks. That's my personal view, I will bring this to the committee. Regards JB On Thu, Mar 7, 2024 at 7:52 AM

Re: [VOTE] Release Apache Iceberg 1.5.0 RC6

2024-03-07 Thread Ajantha Bhat
+1 (non-binding) * validated checksum and signature * checked license docs & ran RAT checks * ran build and tests with JDK11 * *verified view support for Nessie catalog with Spark 3.5.* * *verified this RC against Trino (https://github.com/trinodb/trino/pull/20957