Re: Materialized view integration with REST spec

Hi Walaa Yes, I think it makes sense to go with a vote, now that pros/cons are clearly state in the doc. Thanks ! Regards JB On Tue, Apr 2, 2024 at 3:59 AM Walaa Eldin Moustafa wrote: > > Hi all, there has not been new activity on the doc for some time. Should we > consider voting? > > On Thu,

Re: Materialized view integration with REST spec

+1, I think we have been clear enough about the pros and cons of each option. On Tue, Apr 2, 2024 at 10:00 AM Walaa Eldin Moustafa wrote: > Hi all, there has not been new activity on the doc > > for some

Re: Materialized view integration with REST spec

Hi all, there has not been new activity on the doc for some time. Should we consider voting? On Thu, Mar 28, 2024 at 6:59 AM Jean-Baptiste Onofré wrote: > Yes, correct, thanks Manu for pointing it out. >

Re: Flink table maintenance

Hi Peter, Are you proposing to create a user facing locking feature in Iceberg, or > just something something for internal use? > Since it's a general issue, I'm proposing to create a general user interface first, while the implementation can be left to users. For example, we use Airflow to sched

Re: Flink table maintenance

Hi Ajantha, I thought about enabling post commit topology based compaction for sinks using options, like we use for the parametrization of streaming reads [1]. I think it will be hard to do it in a user friendly way - because of the high number of parameters -, but I think it is a possible solutio

[PROPOSAL] New REST Catalog Spec

Hi folks, With several people from the community, we started to craft a proposal to design new REST Catalog Spec. I used the "proposal process" to track this: - The proposal "issue" is here: https://github.com/apache/iceberg/issues/10075 - The proposal document is here: https://docs.google.com/d

Re: Flink table maintenance

Thanks for the proposal Peter. I just wanted to know do we have any plans for supporting SQL syntax for table maintenance (like CALL procedure) for pure Flink SQL users? I didn't see any custom SQL parser plugin support in Flink. I also saw that Branch write doesn't have SQL support (only Branch r

Re: Flink table maintenance

Hi Manu, Just to clarify: - Are you proposing to create a user facing locking feature in Iceberg, or just something something for internal use? I think we shouldn't add locking to Iceberg's user facing scope in this stage. A fully featured locking system has many more features that we need (prior

Re: Flink table maintenance

> > What would the community think of exploiting tags for preventing > concurrent maintenance loop executions. This issue is not specific to Flink maintenance jobs. We have a service scheduling Spark maintenance jobs by watching table commits. When we don't check in-progress maintenance jobs for