Hi all, I would like to propose the following PR to be potentially included in an upcoming version of Iceberg.
https://github.com/apache/iceberg/pull/9323 Essentially it's a new API that offers improved performance for committing sequential batches of upserts. I have written a detailed explanation in the PR. The performance improvement is very significant for certain producer patterns. Looking forward to hearing the community's opinion on this. Let me know what you think of the approach and whether or not you think this can potentially make it into 1.5. Thanks, -- *Jason Fine* Chief Software Architect M: +972(54)6351336 | E: ja...@upsolver.com | www.upsolver.com