Hey folks, I see that our Java implementation does not follow the spec when it comes to storing equality field IDs. The spec says that column is for equality deletes only. However, our builder for DataFile allows setting and persisting that field in the metadata. To make things worse, the action for rewriting manifests would drop that field for data files even if it was persisted initially.
Do we see value in this field for data files or shall we fix the implementation to follow the spec? We already annotate each snapshot with a set of equality IDs. Are there use cases where it is not enough for data files? If not, I’d rather disallow setting it. - Anton
