Hi All,

Starting this thread to revive the discussion on converting Equality
Deletes as Position deletes and see if this is something community wants
now (Happy to contribute in this) considering :
1/ Now it's not just flink but other writers such Kafka-Connect [1]
debezium server for iceberg [2] have emerged which emit equality deletes
and equality deletes doesn't goes well with the readers in general.
2/ We have some features like Row lineage [3] on which we have taken
decided we will not support it with equality deletes
3/ We are doing considerable enhancements in Position deletes in v3 [4]

I see some past work has been done in this context [5] and we have an
action already in our repo.

Let me know your thoughts.

Regards,
Prashant

[1] https://github.com/tabular-io/iceberg-kafka-connect/tree/main
[2] https://github.com/memiiso/debezium-server-iceberg
[3]
https://docs.google.com/document/d/146YuAnU17prnIhyuvbCtCtVSavyd5N7hKryyVRaFDTE/edit#heading=h.f2e8ffw3fu7n
[4]
https://docs.google.com/document/d/18Bqhr-vnzFfQk1S4AgRISkA_5_m5m32Nnc2Cw0zn2XM/edit
[5]
https://github.com/apache/iceberg/blob/main/api/src/main/java/org/apache/iceberg/actions/ConvertEqualityDeleteFiles.java

Reply via email to