Hi Manu This is Walaa's Spark implementation for option 1: https://github.com/apache/iceberg/pull/9830/files/a9e1bee3b5bf5914e5330d3b195042aea33868c9 There's no code for option 2 yet.
Best Benny On Mon, Mar 25, 2024 at 12:37 AM Manu Zhang <owenzhang1...@gmail.com> wrote: > Thanks Walaa for the summary. It's unclear to me which are the reference > implementation for option 1 and reference MV spec for option 2 from the > context. I can find some links in the References section but not sure which > should be referred to respectively. > > On Mon, Mar 25, 2024 at 3:38 AM Walaa Eldin Moustafa < > wa.moust...@gmail.com> wrote: > >> Thanks Himadri for the questions. At this point, our objective is to have >> a common understanding of both options and their pros and cons. The best >> way to achieve this is to iterate on the doc to discuss the details of each >> option or their pros and cons. We can always add more details or update the >> pros and cons. The main thing is to keep the options to two so that we keep >> the scope manageable. >> >> Once we have a common understanding, it will be easy to make a choice and >> move forward. Therefore, I would suggest reframing your questions as either >> adding suggestions to add more details to the options, questions on how >> either works, or discussions of their pros and cons on the doc. >> >> Thanks, >> Walaa. >> >>
