Re: Summary of Iceberg Materialized View Meeting

2024-06-20 Thread Jan Kaul
Great idea, let's try to resolve all issues in the doc until 30th June and if there are still some open points we will have another meeting. Best wishes Jan On 20.06.24 19:10, Walaa Eldin Moustafa wrote: Jan, I think there are a couple of open questions on the doc. Let us discuss them on the

Re: Summary of Iceberg Materialized View Meeting

2024-06-20 Thread Walaa Eldin Moustafa
Jan, I think there are a couple of open questions on the doc. Let us discuss them on the doc for a week, then meet again if they are still open? Thanks, Walaa. On Fri, Jun 7, 2024 at 12:27 PM Jan Kaul wrote: > No that's great, thank you. I'm thankful for the input. > > Jan > > Am 07.06.2024 17

Re: Summary of Iceberg Materialized View Meeting

2024-06-07 Thread Jan Kaul
No that's great, thank you. I'm thankful for the input.JanAm 07.06.2024 17:53 schrieb Benny Chow :Looks good Jan.  I'm a bit nit pick on picking good names so I left some comments around that to see what others think.ThanksOn Fri, Jun 7, 2024 at 2:26 AM Jan Kaul wrote: Tha

Re: Summary of Iceberg Materialized View Meeting

2024-06-07 Thread Benny Chow
Looks good Jan. I'm a bit nit pick on picking good names so I left some comments around that to see what others think. Thanks On Fri, Jun 7, 2024 at 2:26 AM Jan Kaul wrote: > Thanks Benny and Walaa for your input. I updated the doc >

Re: Summary of Iceberg Materialized View Meeting

2024-06-07 Thread Jan Kaul
Thanks Benny and Walaa for your input. I updated the doc to account for the changes as far as I understood. I would appreciate if you had a look and give me some feedback. If you have some open c

Re: Summary of Iceberg Materialized View Meeting

2024-06-06 Thread Walaa Eldin Moustafa
* lineage state JSON structure On Thu, Jun 6, 2024 at 11:31 PM Walaa Eldin Moustafa wrote: > Hi Benny, > > Your understanding is correct. > > Another point that we discussed was the type of APIs engines can use to > conveniently update the storage table with view query results as well as > set t

Re: Summary of Iceberg Materialized View Meeting

2024-06-06 Thread Walaa Eldin Moustafa
Hi Benny, Your understanding is correct. Another point that we discussed was the type of APIs engines can use to conveniently update the storage table with view query results as well as set the snapshot summary on the output snapshot (one that was produced by the update). We will follow up on tha

Re: Summary of Iceberg Materialized View Meeting

2024-06-06 Thread Benny Chow
I really enjoyed listening to the replay and hearing everyone's feedback! I'm in agreement with all 3 consensus items, especially around Dan's idea to separate the view's query tree lineage vs materialization's lineage state. I'll summarize my understanding about the distinction and add a few comm

Re: Summary of Iceberg Materialized View Meeting

2024-06-06 Thread russell . spitzer
Thanks for hosting it was a very helpful meeting. I really hope we can do more in the future to accelerate consensus on other proposals. I do encourage anyone on the mailing list to add your comments offline as well, especially if you have strong feelings. Iceberg is an open project and we realize

Summary of Iceberg Materialized View Meeting

2024-06-06 Thread Jan Kaul
Hi all, thanks to all of you who attended the meeting yesterday! It was great to talk to you and I think we made great progress. For those of you who weren't able to attend the meeting, I summarized the main points below: * Question 1*: Should we store the "storage table pointer" as a view pr

Re: Iceberg Materialized View Meeting

2024-06-04 Thread Jan Kaul
Yes, I will record the meeting and will share it on the dev list.Am 04.06.2024 20:02 schrieb Wing Yew Poon :Can you please record the meeting and make the recording available afterwards?Thanks,Wing YewOn Mon, Jun 3, 2024 at 11:32 PM Benny Chow wrote:Thanks for organizing Jan.   I

Re: Iceberg Materialized View Meeting

2024-06-04 Thread Wing Yew Poon
Can you please record the meeting and make the recording available afterwards? Thanks, Wing Yew On Mon, Jun 3, 2024 at 11:32 PM Benny Chow wrote: > Thanks for organizing Jan. I’ll be there! > > Benny > > On Jun 3, 2024, at 11:15 PM, Jan Kaul wrote: > >  > > Hi all, > > we will have a video

Re: Iceberg Materialized View Meeting

2024-06-03 Thread Benny Chow
Thanks for organizing Jan. I’ll be there! Benny > On Jun 3, 2024, at 11:15 PM, Jan Kaul wrote: > >  > Hi all, > > we will have a video call to get together and discuss Iceberg Materialized > Views. The call is on Wednesday, 5 June 2024, 16:00:00 UTC (9:00 PDT) and you > can join the meeti

Iceberg Materialized View Meeting

2024-06-03 Thread Jan Kaul
Hi all, we will have a video call to get together and discuss Iceberg Materialized Views. The call is on *Wednesday, 5 June 2024, 16:00:00 UTC (9:00 PDT)* and you can join the meeting with the following link: https://meet.google.com/ttr-xwnk-wiz On the agenda are: * Store "Storage table po