Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-29 Thread Walaa Eldin Moustafa
Thanks everyone for participating in the proposal and discussions. The vote is now closed and the proposal for separate view and table objects model has passed with the following counts: * 11 (+1) * 1 (0) * 0 (-1) I will start a separate thread for the next steps. Thanks, Walaa. On Fri, Apr 26,

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-26 Thread Jan Kaul
0 On 25.04.24 21:54, Alagappan Maruthappan wrote: +1 for separate table and view objects. On Thu, Apr 25, 2024 at 12:33 PM Russell Spitzer wrote: +1 to separate. > On Apr 25, 2024, at 2:08 PM, Jean-Baptiste Onofré wrote: > > +1 to separate, it makes sense to me. >

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-25 Thread Alagappan Maruthappan
+1 for separate table and view objects. On Thu, Apr 25, 2024 at 12:33 PM Russell Spitzer wrote: > +1 to separate. > > > On Apr 25, 2024, at 2:08 PM, Jean-Baptiste Onofré > wrote: > > > > +1 to separate, it makes sense to me. > > > > Regards > > JB > > > > On Thu, Apr 18, 2024 at 11:50 AM Walaa

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-25 Thread Russell Spitzer
+1 to separate. > On Apr 25, 2024, at 2:08 PM, Jean-Baptiste Onofré wrote: > > +1 to separate, it makes sense to me. > > Regards > JB > > On Thu, Apr 18, 2024 at 11:50 AM Walaa Eldin Moustafa > wrote: >> >> Hi everyone, >> >> I would like to make a proposal for issue [1] to support material

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-25 Thread Jean-Baptiste Onofré
+1 to separate, it makes sense to me. Regards JB On Thu, Apr 18, 2024 at 11:50 AM Walaa Eldin Moustafa wrote: > > Hi everyone, > > I would like to make a proposal for issue [1] to support materialized views > in Iceberg. The support leverages two separate objects, an Iceberg view and > an Iceb

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-25 Thread Walaa Eldin Moustafa
Thanks everyone for participating in the vote/recommendation so far. Let us plan to close the vote by the end of Sunday April 28. Thanks, Walaa. On Tue, Apr 23, 2024 at 12:46 PM Daniel Weeks wrote: > +1 as well for separate objects. I think Netflix has proven this model > works well. Exposu

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-23 Thread Daniel Weeks
+1 as well for separate objects. I think Netflix has proven this model works well. Exposure of the storage table can be handled either through naming convention or be hidden by the catalog, but that's more of an implementation detail. -Dan On Mon, Apr 22, 2024 at 3:00 PM Ryan Blue wrote: > +1

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-22 Thread Ryan Blue
+1 for separate table and view objects and not needing to introduce unnecessary combined APIs. On Mon, Apr 22, 2024 at 1:51 PM Szehon Ho wrote: > +1 for the approach given it reduces the work. On this, as it exposes > storage tables to user catalog, I was mainly thinking we should have a > comm

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-22 Thread Szehon Ho
+1 for the approach given it reduces the work. On this, as it exposes storage tables to user catalog, I was mainly thinking we should have a common suffix/naming pattern for storage table across catalog. The netflix approach sounds good to me. Hope we can continue the proposal, as there's still

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-19 Thread John Zhuge
+1 on separate view and table metadata I'd like to share our experience of such a design at Netflix for years. The changes to the view spec are minimal and there are no changes to the Iceberg table metadata other than tracking an additional table property for capturing freshness. The storage table

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-19 Thread Renjie Liu
+1 for this proposal. On Fri, Apr 19, 2024 at 3:40 PM Ajantha Bhat wrote: > +1 for the proposal. > > - Ajantha > > On Fri, Apr 19, 2024 at 7:29 AM Benny Chow wrote: > >> +1 for separate view and table objects. Walaa's Spark >> implementation demonstrates how little change it takes on the Icebe

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-19 Thread Ajantha Bhat
+1 for the proposal. - Ajantha On Fri, Apr 19, 2024 at 7:29 AM Benny Chow wrote: > +1 for separate view and table objects. Walaa's Spark > implementation demonstrates how little change it takes on the Iceberg APIs > to start sharing MVs between engines. > > Thanks > Benny > > On Thu, Apr 18, 2

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-18 Thread Benny Chow
+1 for separate view and table objects. Walaa's Spark implementation demonstrates how little change it takes on the Iceberg APIs to start sharing MVs between engines. Thanks Benny On Thu, Apr 18, 2024 at 9:52 AM Walaa Eldin Moustafa wrote: > Hi everyone, > > I would like to make a proposal for

Re: [Proposal] Add support for Materialized Views in Iceberg

2024-04-18 Thread Frank
UNSUBSCRIBE Frank Gilroy 484-868-7097 On Thu, Apr 18, 2024 at 12:52 PM Walaa Eldin Moustafa wrote: > Hi everyone, > > I would like to make a proposal for issue [1] to support materialized > views in Iceberg. The support leverages two separate objects, an Iceberg > view and an Iceberg table to

[Proposal] Add support for Materialized Views in Iceberg

2024-04-18 Thread Walaa Eldin Moustafa
Hi everyone, I would like to make a proposal for issue [1] to support materialized views in Iceberg. The support leverages two separate objects, an Iceberg view and an Iceberg table to implement materialized views. Each object retains relevant metadata to support the MV operations. An initial desi