+1, Id be happy to see this feature. Thanks Szehon
On Fri, Sep 13, 2024 at 10:33 AM Prashant Singh <prashant010...@gmail.com> wrote: > Hi All, > > Starting this thread to revive the discussion on converting Equality > Deletes as Position deletes and see if this is something community wants > now (Happy to contribute in this) considering : > 1/ Now it's not just flink but other writers such Kafka-Connect [1] > debezium server for iceberg [2] have emerged which emit equality deletes > and equality deletes doesn't goes well with the readers in general. > 2/ We have some features like Row lineage [3] on which we have taken > decided we will not support it with equality deletes > 3/ We are doing considerable enhancements in Position deletes in v3 [4] > > I see some past work has been done in this context [5] and we have an > action already in our repo. > > Let me know your thoughts. > > Regards, > Prashant > > [1] https://github.com/tabular-io/iceberg-kafka-connect/tree/main > [2] https://github.com/memiiso/debezium-server-iceberg > [3] > https://docs.google.com/document/d/146YuAnU17prnIhyuvbCtCtVSavyd5N7hKryyVRaFDTE/edit#heading=h.f2e8ffw3fu7n > [4] > https://docs.google.com/document/d/18Bqhr-vnzFfQk1S4AgRISkA_5_m5m32Nnc2Cw0zn2XM/edit > [5] > https://github.com/apache/iceberg/blob/main/api/src/main/java/org/apache/iceberg/actions/ConvertEqualityDeleteFiles.java >
