Re: [DISCUSS] Apache Iceberg Release 1.3.1

2023-07-12 Thread Szehon Ho
Hi guys Just an update on this. Another issue came up about the new 1.3.0 function rewrite_position_deletes (thanks Fokko for adding to the milestone). I'm working on that, hopefully can finish in next day or two, for this release. Milestone for reference: https://github.com/apache/iceberg/mile

Re: [DISCUSS] Apache Iceberg Release 1.3.1

2023-07-12 Thread Fokko Driesprong
Hi Szehon, Thank you for the updates. I'm in favor of 1.3.1 as well. I got notified of a discrepancy in Java's TableMetadata reader today. I have a fix here against the master branch. Once that is in, I thi

Re: Code review: [spark] skip empty file during table migration, table snapshotting or adding files

2023-07-12 Thread Pucheng Yang
Hi community, I raised another PR on the same topic, can you help review? Thanks PR1: https://github.com/apache/iceberg/pull/8040 [spark 3.4] skip empty file during table migration, table snapshotting or adding files PR2: https://github.com/apache/iceberg/pull/8051 [spark 3.4] add remove_empty_fi