Re: Materialized Views: Next Steps

2024-05-20 Thread Daniel Weeks
Walaa, I think Ryan's comment was more in relation to the combined metadata approach (which is not the current proposal). I don't think anything that's being discussed at this point helps or hurts the view integration story with catalog apis. -Dan On Mon, May 20, 2024 at 1:21 PM Walaa Eldin Mo

Re: Materialized Views: Next Steps

2024-05-20 Thread Daniel Weeks
I know I'm coming in late here, but I'm still working through all the prior discussion. Here are my thoughts so far: I agree that Jan's doc has some really good context and we should continue from there, but we should remove discussion of options as it just creates confusion. We can reference ot

Re: Proposal for REST APIs for Iceberg table scans

2024-05-20 Thread Jack Ye
We merged the spec change for content file in https://github.com/apache/iceberg/pull/9717, the next step is to merge the PlanTable and PreplanTable API spec change in https://github.com/apache/iceberg/pull/9695. I guess people were a bit busy in the past few weeks due to the Iceberg summit, you sho

Re: Pagination for List APIs in the REST spec

2024-05-20 Thread Pucheng Yang
You are right, thanks Jack. On Mon, May 20, 2024 at 8:06 AM Jack Ye wrote: > I believe this is already merged? > https://github.com/apache/iceberg/pull/9782 > > Best, > Jack Ye > > On Sat, May 18, 2024 at 4:06 PM Pucheng Yang > wrote: > >> Hi all, is there an ETA for this? thanks >> >> On Wed,

Re: Pagination for List APIs in the REST spec

2024-05-20 Thread Jack Ye
I believe this is already merged? https://github.com/apache/iceberg/pull/9782 Best, Jack Ye On Sat, May 18, 2024 at 4:06 PM Pucheng Yang wrote: > Hi all, is there an ETA for this? thanks > > On Wed, Dec 20, 2023 at 6:03 PM Renjie Liu > wrote: > >> I think if servers provide a meaningful error

Re: Materialized Views: Next Steps

2024-05-20 Thread Jack Ye
Sorry I digressed the discussion a bit. For time travel related design I think we can move to https://github.com/apache/iceberg/pull/10280#discussion_r1596091824 to discuss further. My point of describing that was more to say it seems sufficient to use properties to describe those time travel cases