RE: Flink table maintenance

- Technically would it be possible not to force partition cols into the PK? I believe this is possible, but probably less performant. It is mentioned in the docs https://iceberg.apache.org/spec/#scan-planning >From the documentation: "An equality delete file must be applied to a data file when a

getting MERGE INTO TABLE is not supported temporarily.

Hi all congratulations all for the new release 11, Im trying to create SCD 2 table using new MERGE INTO feature but getting "MERGE INTO TABLE is not supported temporarily." error cant see what is wrong using spark 3.1.1 and iceberg 0.11.0 full code is here : https://github.com/ismailsimsek/i

Re: getting MERGE INTO TABLE is not supported temporarily.

as not been released yet, so we went > ahead with the 0.11.0 release. We will follow up with fixes for the issues > hit in 3.1. > > For now, I recommend using Spark 3.0.1 if you want to try out the new DDL, > DELETE, or MERGE syntax. > > rb > > On Fri, Jan 29, 2021 at 11

Re: [DISCUSS] Apache Iceberg (java) 1.8.0 release

Hi, Is it possible to include these two changes too? https://github.com/apache/iceberg/pull/11906 https://github.com/apache/iceberg/pull/11936 Thanks ismail On 2025/01/09 06:51:28 Jean-Baptiste Onofré wrote: > Hi folks, > > We did Apache Iceberg 1.7.0 release on Nov 8, 2024. If we want to keep >

Re: [DISCUSS] Pre-Proposal: Improving Merge-On-Read Query Performance With Indexing

Hi All, Thank you for working on this. I wanted to share a reference to the BigQuery implementation (Option 3) as another potential approach, and for inspiration. In this setup, The engine is running periodic merge jo

[DISCUSS] Kafka Connect delta writer support

Hi All, I have ported the Kafka Connect delta writer feature, however there are some questions around should we support it or wait for the new solution for Equality deletes. And there is some interest from the community to have it, so opening this threat to discuss it. PR https://github.com/apac